Jul 09 17:27:54.372671 ip-10-0-129-85 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.681209    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685630    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685641    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685645    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685648    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685651    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685653    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685658    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:27:54.753793 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685662    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:27:54.745131 ip-10-0-129-85 systemd[1]: Started Kubernetes Kubelet.
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685665    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685667    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685670    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685672    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685675    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685677    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685680    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685682    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685686    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685688    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685691    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685695    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685698    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685706    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685709    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685711    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685722    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685725    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685727    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:27:54.756790 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685730    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685734    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685738    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685741    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685743    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685746    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685749    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685751    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685754    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685758    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685761    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685764    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685766    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685769    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685771    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685774    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685776    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685779    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685782    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:27:54.765985 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685784    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685787    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685791    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685793    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685796    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685799    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685802    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685804    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.685847    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686027    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686035    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686040    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686044    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686049    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686054    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686059    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686063    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686068    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686072    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:27:54.767139 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686084    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686088    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686093    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686097    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686118    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686123    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686128    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686132    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686137    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686141    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686146    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686150    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686154    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686164    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686168    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686173    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686177    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686181    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686185    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686190    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:27:54.768075 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686194    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686199    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686230    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686235    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686240    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686244    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686253    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686258    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686262    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686266    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686270    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686274    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686278    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.686282    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687556    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687566    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687570    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687573    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687576    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687579    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687582    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:27:54.768966 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687585    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687587    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687590    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687592    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687595    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687597    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687600    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687603    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687605    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687608    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687611    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687614    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687617    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687620    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687622    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687625    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687628    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687631    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687634    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:27:54.769855 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687637    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687640    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687644    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687648    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687651    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687653    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687656    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687658    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687661    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687663    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687666    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687669    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687671    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687674    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687676    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687679    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687681    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687685    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687688    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:27:54.770941 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687690    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687693    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687695    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687698    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687701    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687704    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687707    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687709    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687712    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687715    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687717    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687720    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687722    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687725    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687727    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687730    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687733    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687740    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687742    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687745    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:27:54.771815 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687747    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687750    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687754    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687756    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687758    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687761    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687765    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687770    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687773    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687776    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687779    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687782    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687785    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687787    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687790    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687792    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687795    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687797    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687800    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687802    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:27:54.772831 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687805    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687808    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687810    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687813    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687816    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687818    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687821    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687824    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687826    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687829    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687831    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687835    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687839    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.687842    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688187    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688191    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688195    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688198    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688202    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688205    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:27:54.773702 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688208    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688211    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688213    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688216    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688219    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688221    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688224    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688226    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688229    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688232    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688234    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688237    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688239    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688242    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688244    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688249    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688252    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688255    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688257    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688259    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:27:54.774599 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688262    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688265    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688267    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688270    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688272    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688274    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688279    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688281    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688284    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688287    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688289    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688292    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688295    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688297    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688300    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688302    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688305    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688307    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688310    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:27:54.775414 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688312    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688314    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688317    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688319    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688322    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688325    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688327    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688329    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688335    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688338    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688340    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688343    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688346    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688349    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688351    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688354    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688356    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688359    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688361    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688365    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:27:54.776327 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688368    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688370    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688373    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688375    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688378    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688382    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688384    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688387    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688389    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688391    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688395    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688412    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688414    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688418    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688422    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688424    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688428    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688432    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688435    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:27:54.777204 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688438    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688442    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688445    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688448    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688452    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688455    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688458    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688461    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688463    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688466    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688469    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688471    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688475    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688478    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.688481    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688546    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688556    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688569    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688584    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688588    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688592    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 17:27:54.778066 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688596    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688600    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688603    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688606    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688609    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688613    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688616    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688619    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688621    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688624    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688627    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688630    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688635    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688638    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688641    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688644    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688647    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688650    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688653    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688656    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688660    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688663    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688665    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688670    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 17:27:54.778961 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688673    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688676    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688679    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688682    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688685    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688688    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688691    2583 flags.go:64] FLAG: --enable-server="true"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688694    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688698    2583 flags.go:64] FLAG: --event-burst="100"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688701    2583 flags.go:64] FLAG: --event-qps="50"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688704    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688707    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688710    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688713    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688716    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688719    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688722    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688724    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688727    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688730    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688734    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688737    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688740    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688742    2583 flags.go:64] FLAG: --feature-gates=""
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688746    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 17:27:54.780064 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688749    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688752    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688755    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688757    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688760    2583 flags.go:64] FLAG: --help="false"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688763    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-129-85.ec2.internal"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688769    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688771    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688774    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688777    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688781    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688784    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688787    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688790    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688792    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688800    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688804    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688807    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688810    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688813    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688816    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688818    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688821    2583 flags.go:64] FLAG: --lock-file=""
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688824    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 17:27:54.781147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688826    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688829    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688835    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688839    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688842    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688844    2583 flags.go:64] FLAG: --logging-format="text"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688847    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688851    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688853    2583 flags.go:64] FLAG: --manifest-url=""
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688856    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688860    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688863    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688866    2583 flags.go:64] FLAG: --max-pods="110"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688869    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688874    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688877    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688880    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688882    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688885    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688888    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688895    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688898    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688901    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 17:27:54.782240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688904    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688907    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688913    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688916    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688919    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688922    2583 flags.go:64] FLAG: --port="10250"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688925    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688927    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-014be5c543ae39075"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688930    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688933    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688936    2583 flags.go:64] FLAG: --register-node="true"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688939    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688944    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688947    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688949    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688952    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688955    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688958    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688961    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688964    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688967    2583 flags.go:64] FLAG: --runonce="false"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688969    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688972    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688975    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688979    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 17:27:54.783328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688982    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688985    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688988    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688991    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688993    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688996    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.688999    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689001    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689005    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689008    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689011    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689016    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689019    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689021    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689025    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689027    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689030    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689033    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689036    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689040    2583 flags.go:64] FLAG: --v="2"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689043    2583 flags.go:64] FLAG: --version="false"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689047    2583 flags.go:64] FLAG: --vmodule=""
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689051    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.689054    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689161    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:27:54.784642 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689165    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689169    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689172    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689175    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689177    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689180    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689184    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689186    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689189    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689192    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689194    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689197    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689200    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689202    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689205    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689207    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689209    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689213    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689215    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689218    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:27:54.787844 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689220    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689223    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689225    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689228    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689231    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689233    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689237    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689239    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689242    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689244    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689247    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689249    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689252    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689254    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689257    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689259    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689262    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689264    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689269    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:27:54.788728 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689271    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689274    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689276    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689279    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689282    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689284    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689286    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689289    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689292    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689294    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689297    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689300    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689302    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689305    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689307    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689310    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689313    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689315    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689318    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:27:54.992509 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689321    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689326    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689329    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689332    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689334    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689337    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689340    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689343    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689345    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689348    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689351    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689354    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689360    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689363    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689366    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689369    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689371    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689374    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689377    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:27:55.038626 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689379    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689382    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689384    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689387    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689390    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689392    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689395    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689412    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689416    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689418    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689421    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689424    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689429    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689435    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689438    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689441    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689443    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689446    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689448    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689451    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:27:55.039862 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.689454    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.690125    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.696395    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.696426    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.696968    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.696975    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697032    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697038    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697042    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697044    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697047    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697050    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697053    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697055    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697058    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:27:55.041028 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697060    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697063    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697066    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697068    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697071    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697075    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697079    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697082    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697085    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697088    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697091    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697093    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697096    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697099    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697101    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697104    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697106    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697109    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697111    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697115    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:27:55.041780 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697118    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697121    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697124    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697127    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697129    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697132    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697134    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697137    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697140    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697142    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697145    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697147    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697150    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697152    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697155    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697157    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697160    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697162    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697165    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697168    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:27:55.042470 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697170    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697172    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697175    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697178    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697180    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697183    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697185    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697188    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697190    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697196    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697198    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697201    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697205    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697208    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697211    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697214    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697217    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697219    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697222    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:27:55.043215 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697224    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697227    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697229    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697232    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697234    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697237    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697240    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697242    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697246    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697250    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697253    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697256    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697259    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697261    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697264    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697267    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697271    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697275    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697277    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:27:55.043980 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697280    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697283    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697286    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697290    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697293    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697295    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697299    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697302    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697308    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697311    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697313    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697316    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.697321    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697450    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697456    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 17:27:55.044735 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697459    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697462    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697465    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697468    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697471    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697474    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697476    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697479    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697481    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697484    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697486    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697489    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697493    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697496    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697499    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697502    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697505    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697507    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697510    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 17:27:55.045246 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697512    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697516    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697519    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697522    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697524    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697529    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697533    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697536    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697538    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697541    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697544    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697547    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697549    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697552    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697554    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697557    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697559    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697562    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697564    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 17:27:55.045990 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697567    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697570    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697573    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697575    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697578    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697580    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697583    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697585    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697588    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697590    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697593    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697595    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697598    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697600    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697604    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697606    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697609    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697611    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697615    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697617    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 17:27:55.046601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697620    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697623    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697627    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697630    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697632    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697635    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697638    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697641    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697643    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697646    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697648    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697651    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697653    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697656    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697658    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697661    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697664    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697666    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697669    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 17:27:55.047370 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697671    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697673    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697676    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697678    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697681    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697684    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697686    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697690    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697693    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697695    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697698    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697701    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697704    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697707    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697709    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697712    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697721    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697724    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697727    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 17:27:55.048126 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:54.697730    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.697735    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.697837    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.699809    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.700905    2583 server.go:1019] "Starting client certificate rotation"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.701047    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.701077    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.702904    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.704334    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.714053    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.716009    2583 log.go:25] "Validated CRI v1 image API"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.716874    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 17:27:55.048746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.718950    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 be2a9b32-07b0-47c9-8545-52e62f049b84:/dev/nvme0n1p3 beda08f9-db9f-4e80-86ee-0c591f809ebf:/dev/nvme0n1p4]
Jul 09 17:27:55.049235 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.718967    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 17:27:55.049766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.724077    2583 manager.go:216] Machine: {Timestamp:2026-07-09 17:27:54.722984237 +0000 UTC m=+0.255502959 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099452 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2db3d2224b2f67295198ff7cc38d8d SystemUUID:ec2db3d2-224b-2f67-2951-98ff7cc38d8d BootID:ce44f5f4-3d5e-4fff-9b8b-7fc32a500833 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:81:c3:f4:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:81:c3:f4:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:57:e4:93:c8:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 17:27:55.049766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.724175    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 17:27:55.049766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.724265    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 17:27:55.049766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.726818    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 17:27:55.049766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.727295    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 17:27:55.049766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.728423    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 17:27:55.049766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.728439    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 17:27:55.049766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.728448    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.728945    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.729683    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.733139    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.733252    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.733276    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.733285    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.733300    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.733308    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.733318    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.733592    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.733614    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.734340    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.735337    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737240    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737267    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737891    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737905    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737912    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737917    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737928    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737933    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737941    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737946    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737953    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737958    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737967    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.737972    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.738593    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.738601    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.741471    2583 server.go:1268] "Started kubelet"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.741568    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.741650    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.742203    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.744606    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.747507    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.747528    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.747663    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-85.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.747711    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 17:27:55.050249 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.748236    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.747377    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-85.ec2.internal.18c0af305fee1e8d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-85.ec2.internal,UID:ip-10-0-129-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-85.ec2.internal,},FirstTimestamp:2026-07-09 17:27:54.741448333 +0000 UTC m=+0.273967053,LastTimestamp:2026-07-09 17:27:54.741448333 +0000 UTC m=+0.273967053,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-85.ec2.internal,}"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.749353    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.749354    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.749534    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.753678    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.754244    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.754260    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.754418    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.754432    2583 factory.go:55] Registering systemd factory
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.754440    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.754418    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.754481    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.755038    2583 factory.go:153] Registering CRI-O factory
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.755051    2583 factory.go:223] Registration of the crio container factory successfully
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.755068    2583 factory.go:103] Registering Raw factory
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.755077    2583 manager.go:1196] Started watching for new ooms in manager
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.755534    2583 manager.go:349] Starting recovery of all containers
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.756612    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.756732    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.758498    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7vn5v"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.765507    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7vn5v"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.759190    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.799541    2583 manager.go:354] Recovery completed
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.803561    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.805234    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.805258    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.805269    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.805699    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.805706    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.805707    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.805761    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.806302    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:27:55.051525 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.806324    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.806334    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.807088    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-85.ec2.internal.18c0af3063bb984f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-85.ec2.internal,UID:ip-10-0-129-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-85.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-85.ec2.internal,},FirstTimestamp:2026-07-09 17:27:54.805246031 +0000 UTC m=+0.337764751,LastTimestamp:2026-07-09 17:27:54.805246031 +0000 UTC m=+0.337764751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-85.ec2.internal,}"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.809806    2583 policy_none.go:49] "None policy: Start"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.809819    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.809828    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.811760    2583 policy_none.go:47] "Start"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.850482    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.855919    2583 manager.go:337] "Starting Device Plugin manager"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.855948    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.855957    2583 server.go:87] "Starting device plugin registration server"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.856134    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.856146    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.856267    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.856336    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.856345    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.856759    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.856797    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.914016    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.914043    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.914058    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.914087    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.916308    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.956504    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.957147    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.957168    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.957179    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.957198    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-85.ec2.internal"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.964891    2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-85.ec2.internal\" not found" node="ip-10-0-129-85.ec2.internal"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:54.965545    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-85.ec2.internal"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:54.965558    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-85.ec2.internal\": node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.017502    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal"]
Jul 09 17:27:55.052567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.017550    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.018420    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.018447    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.018460    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.021182    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.021295    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.021317    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.021815    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.021832    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.021817    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.021845    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.021866    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.021877    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.024049    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.024068    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.024692    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.024711    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.024720    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID"
Jul 09 17:27:55.055622 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:55.030266    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:55.163869 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:55.067917    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-85.ec2.internal\" not found" node="ip-10-0-129-85.ec2.internal"
Jul 09 17:27:55.163869 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:55.072069    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-85.ec2.internal\" not found" node="ip-10-0-129-85.ec2.internal"
Jul 09 17:27:55.163869 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:55.130346    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:55.163869 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.157357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b91921211232e6c562c46bbcbbc9ca7e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-85.ec2.internal\" (UID: \"b91921211232e6c562c46bbcbbc9ca7e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:55.163869 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.157379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a2a2dba3aa322612eb9f7051046eb689-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"a2a2dba3aa322612eb9f7051046eb689\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:55.163869 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:55.157412    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a2dba3aa322612eb9f7051046eb689-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"a2a2dba3aa322612eb9f7051046eb689\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.016836 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:56.980436    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:57.016836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.008023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a2a2dba3aa322612eb9f7051046eb689-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"a2a2dba3aa322612eb9f7051046eb689\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.016836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.008043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a2dba3aa322612eb9f7051046eb689-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"a2a2dba3aa322612eb9f7051046eb689\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.016836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.008059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b91921211232e6c562c46bbcbbc9ca7e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-85.ec2.internal\" (UID: \"b91921211232e6c562c46bbcbbc9ca7e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.016836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.008098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b91921211232e6c562c46bbcbbc9ca7e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-85.ec2.internal\" (UID: \"b91921211232e6c562c46bbcbbc9ca7e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.016836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.008119    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a2a2dba3aa322612eb9f7051046eb689-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"a2a2dba3aa322612eb9f7051046eb689\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.016836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.008130    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2a2dba3aa322612eb9f7051046eb689-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"a2a2dba3aa322612eb9f7051046eb689\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.087671 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:57.081154    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:57.173443 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.124730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.173443 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.125781    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.398414 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:57.181880    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:57.398414 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:57.282460    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:57.398414 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:57.383056    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:57.637896 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.450637    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 17:27:57.637896 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.450755    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 17:27:57.637896 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:57.483836    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:57.637896 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.548106    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 17:22:56 +0000 UTC" deadline="2027-12-15 06:14:23.948528316 +0000 UTC"
Jul 09 17:27:57.637896 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.548135    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12564h46m26.400395551s"
Jul 09 17:27:57.637896 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:57.584239    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:57.739672 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:57.684589    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:57.739672 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.703581    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:27:57.798659 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:57.785132    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found"
Jul 09 17:27:57.930170 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.886527    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:27:57.946845 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.946827    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.957283 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.957268    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 17:27:57.958750 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.958730    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal"
Jul 09 17:27:57.967209 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:57.967172    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 17:27:58.033134 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.033116    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:27:58.068274 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.068246    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a2dba3aa322612eb9f7051046eb689.slice/crio-34668ce80fabeaf8cc405900dca0f199b34263a3598d5a11247641b597333980 WatchSource:0}: Error finding container 34668ce80fabeaf8cc405900dca0f199b34263a3598d5a11247641b597333980: Status 404 returned error can't find the container with id 34668ce80fabeaf8cc405900dca0f199b34263a3598d5a11247641b597333980
Jul 09 17:27:58.068462 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.068436    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91921211232e6c562c46bbcbbc9ca7e.slice/crio-ce657a59a2bfbb7f71e35ac8fc844227c9794ddb7044ceceb0ec2a71bfe906c3 WatchSource:0}: Error finding container ce657a59a2bfbb7f71e35ac8fc844227c9794ddb7044ceceb0ec2a71bfe906c3: Status 404 returned error can't find the container with id ce657a59a2bfbb7f71e35ac8fc844227c9794ddb7044ceceb0ec2a71bfe906c3
Jul 09 17:27:58.071946 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.071930    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:27:58.484009 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.483986    2583 apiserver.go:52] "Watching apiserver"
Jul 09 17:27:58.493238 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.493182    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 17:27:58.493599 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.493573    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-62pn5","openshift-multus/multus-additional-cni-plugins-pnrtm","openshift-multus/multus-c2tqn","openshift-multus/network-metrics-daemon-zln6d","openshift-ovn-kubernetes/ovnkube-node-qcpcg","kube-system/global-pull-secret-syncer-2d4dg","kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x7dlj","openshift-dns/node-resolver-59fkz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal","openshift-network-diagnostics/network-check-target-cmvcs","openshift-network-operator/iptables-alerter-nnn9b","kube-system/konnectivity-agent-4pnt6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"]
Jul 09 17:27:58.497389 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.497367    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:27:58.499626 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.499603    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.499816 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.499793    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 17:27:58.500267 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.500246    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 17:27:58.500349 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.500251    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bx54m\""
Jul 09 17:27:58.500349 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.500323    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 17:27:58.501795 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.501776    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.502188 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.502166    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 17:27:58.502354 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.502279    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qcpc4\""
Jul 09 17:27:58.502426 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.502405    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 17:27:58.502557 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.502542    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 17:27:58.502678 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.502570    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 17:27:58.502678 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.502547    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 17:27:58.503985 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.503966    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:27:58.504094 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.504040    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:27:58.504346 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.504328    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z8fcr\""
Jul 09 17:27:58.504436 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.504377    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 17:27:58.506372 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.506350    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.508509 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.508489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:58.508595 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.508542    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:27:58.508988 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.508959    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 17:27:58.509375 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.509353    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 17:27:58.509510 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.509468    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 17:27:58.509587 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.509530    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 17:27:58.509587 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.509569    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h8bbk\""
Jul 09 17:27:58.509752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.509618    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 17:27:58.509752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.509692    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 17:27:58.510887 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.510871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.513192 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.513174    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.513810 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.513792    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 17:27:58.513977 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.513961    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 17:27:58.513977 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.513971    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 17:27:58.514359 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.514344    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8wjsp\""
Jul 09 17:27:58.515407 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.515392    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.515867 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.515840    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9q7fj\""
Jul 09 17:27:58.516211 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.516175    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 17:27:58.516323 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.516300    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:27:58.516436 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.516419    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 17:27:58.518141 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.518119    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.518848 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.518747    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tfntx\""
Jul 09 17:27:58.519034 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.518987    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 17:27:58.519133 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.519079    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 17:27:58.520891 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.520857    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 17:27:58.521027 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.520971    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 17:27:58.521468 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.521145    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 17:27:58.521468 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.521174    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4hkht\""
Jul 09 17:27:58.521658 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.521640    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:27:58.521980 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.521908    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:27:58.525468 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.525447    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.528020 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.527993    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:27:58.528217 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.528185    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 17:27:58.528368 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.528353    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 17:27:58.528477 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.528378    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nft6m\""
Jul 09 17:27:58.533365 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.533346    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w4k6k"
Jul 09 17:27:58.540375 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.540358    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w4k6k"
Jul 09 17:27:58.552054 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:27:58.552137 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-log-socket\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552137 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-cni-bin\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552137 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-cni-netd\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552269 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4557981e-bf4c-4cc2-9cf9-12fa46137668-ovnkube-config\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552269 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/817a083d-1599-4594-acf4-4c6548882747-konnectivity-ca\") pod \"konnectivity-agent-4pnt6\" (UID: \"817a083d-1599-4594-acf4-4c6548882747\") " pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:27:58.552269 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-cnibin\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.552374 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552284    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-cnibin\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552374 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552309    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-kubelet\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552374 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-systemd-units\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552374 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-run-ovn\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4557981e-bf4c-4cc2-9cf9-12fa46137668-env-overrides\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4557981e-bf4c-4cc2-9cf9-12fa46137668-ovnkube-script-lib\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/817a083d-1599-4594-acf4-4c6548882747-agent-certs\") pod \"konnectivity-agent-4pnt6\" (UID: \"817a083d-1599-4594-acf4-4c6548882747\") " pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:27:58.552512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.552512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552468    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-run-netns\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-var-lib-openvswitch\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552703 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-run-openvswitch\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552703 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552551    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552703 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-multus-socket-dir-parent\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552703 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/757899f3-7ab9-4214-b494-b457ad9a8986-multus-daemon-config\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552703 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-etc-kubernetes\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552703 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rg9l\" (UniqueName: \"kubernetes.io/projected/75e411b6-ea5d-48ef-b050-3819a0dee45a-kube-api-access-9rg9l\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:27:58.552703 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552682    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28f05b04-e9c8-40cc-a1a9-506eda546585-cni-binary-copy\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.552931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28f05b04-e9c8-40cc-a1a9-506eda546585-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.552931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-multus-cni-dir\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-os-release\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-run-netns\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-run-multus-certs\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-run-ovn-kubernetes\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.552931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552873    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-var-lib-cni-bin\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552895    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-var-lib-cni-multus\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.552931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-multus-conf-dir\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552942    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf4m2\" (UniqueName: \"kubernetes.io/projected/757899f3-7ab9-4214-b494-b457ad9a8986-kube-api-access-sf4m2\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552967    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-system-cni-dir\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.552993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4557981e-bf4c-4cc2-9cf9-12fa46137668-ovn-node-metrics-cert\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28f05b04-e9c8-40cc-a1a9-506eda546585-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x49p5\" (UniqueName: \"kubernetes.io/projected/28f05b04-e9c8-40cc-a1a9-506eda546585-kube-api-access-x49p5\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-system-cni-dir\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/757899f3-7ab9-4214-b494-b457ad9a8986-cni-binary-copy\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553122    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-var-lib-kubelet\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-hostroot\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-slash\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-etc-openvswitch\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-node-log\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553275    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-run-k8s-cni-cncf-io\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.553358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-run-systemd\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.553891 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553337    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjzc8\" (UniqueName: \"kubernetes.io/projected/4557981e-bf4c-4cc2-9cf9-12fa46137668-kube-api-access-fjzc8\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.553891 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.553387    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-os-release\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.604915 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.604898    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 17:27:58.653592 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjzc8\" (UniqueName: \"kubernetes.io/projected/4557981e-bf4c-4cc2-9cf9-12fa46137668-kube-api-access-fjzc8\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-os-release\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4cfq\" (UniqueName: \"kubernetes.io/projected/db60da2c-6cce-408a-9bc4-923b9ea3a79f-kube-api-access-b4cfq\") pod \"node-resolver-59fkz\" (UID: \"db60da2c-6cce-408a-9bc4-923b9ea3a79f\") " pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-modprobe-d\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-sysctl-conf\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653708    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-os-release\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653757    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-log-socket\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653784    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-cni-netd\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4557981e-bf4c-4cc2-9cf9-12fa46137668-ovnkube-config\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-log-socket\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-cni-netd\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.653951    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/817a083d-1599-4594-acf4-4c6548882747-konnectivity-ca\") pod \"konnectivity-agent-4pnt6\" (UID: \"817a083d-1599-4594-acf4-4c6548882747\") " pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:27:58.654110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-kubelet\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-systemd-units\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654156    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-run-ovn\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654172    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-kubelet\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4557981e-bf4c-4cc2-9cf9-12fa46137668-env-overrides\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-systemd-units\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4557981e-bf4c-4cc2-9cf9-12fa46137668-ovnkube-script-lib\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654275    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-run-ovn\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654359    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-multus-socket-dir-parent\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-etc-kubernetes\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-run-openvswitch\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654567    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c6c2219-d209-4d94-a17e-5eb6baa05c02-kubelet-config\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654573    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/817a083d-1599-4594-acf4-4c6548882747-konnectivity-ca\") pod \"konnectivity-agent-4pnt6\" (UID: \"817a083d-1599-4594-acf4-4c6548882747\") " pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-run\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.654749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-sys\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4557981e-bf4c-4cc2-9cf9-12fa46137668-env-overrides\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654645    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-tmp\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxvl\" (UniqueName: \"kubernetes.io/projected/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-kube-api-access-lxxvl\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28f05b04-e9c8-40cc-a1a9-506eda546585-cni-binary-copy\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-multus-socket-dir-parent\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654751    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-multus-cni-dir\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654751    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654807    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-run-openvswitch\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654815    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-multus-cni-dir\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654843    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-run-multus-certs\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654853    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4557981e-bf4c-4cc2-9cf9-12fa46137668-ovnkube-script-lib\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654871    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db60da2c-6cce-408a-9bc4-923b9ea3a79f-hosts-file\") pod \"node-resolver-59fkz\" (UID: \"db60da2c-6cce-408a-9bc4-923b9ea3a79f\") " pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-kubernetes\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.655638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654903    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-run-multus-certs\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654922    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf4m2\" (UniqueName: \"kubernetes.io/projected/757899f3-7ab9-4214-b494-b457ad9a8986-kube-api-access-sf4m2\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654948    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-var-lib-kubelet\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654965    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-etc-kubernetes\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654973    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28f05b04-e9c8-40cc-a1a9-506eda546585-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.654994    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4557981e-bf4c-4cc2-9cf9-12fa46137668-ovnkube-config\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x49p5\" (UniqueName: \"kubernetes.io/projected/28f05b04-e9c8-40cc-a1a9-506eda546585-kube-api-access-x49p5\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-system-cni-dir\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655100    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/757899f3-7ab9-4214-b494-b457ad9a8986-cni-binary-copy\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/428cf71a-d839-4997-9aec-614cedd0bf3d-serviceca\") pod \"node-ca-62pn5\" (UID: \"428cf71a-d839-4997-9aec-614cedd0bf3d\") " pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655147    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c6c2219-d209-4d94-a17e-5eb6baa05c02-dbus\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655169    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-socket-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-sys-fs\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655236    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-node-log\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.656256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28f05b04-e9c8-40cc-a1a9-506eda546585-cni-binary-copy\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db60da2c-6cce-408a-9bc4-923b9ea3a79f-tmp-dir\") pod \"node-resolver-59fkz\" (UID: \"db60da2c-6cce-408a-9bc4-923b9ea3a79f\") " pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655283    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rdn\" (UniqueName: \"kubernetes.io/projected/4dd7133a-00c4-429b-921c-68cbaaede936-kube-api-access-86rdn\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-run-systemd\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-run-systemd\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655376    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-system-cni-dir\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655381    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-node-log\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-device-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655483    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-cni-bin\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655537    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-cni-bin\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.655580    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.655634    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs podName:75e411b6-ea5d-48ef-b050-3819a0dee45a nodeName:}" failed. No retries permitted until 2026-07-09 17:27:59.155615719 +0000 UTC m=+2.938335034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs") pod "network-metrics-daemon-zln6d" (UID: "75e411b6-ea5d-48ef-b050-3819a0dee45a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:27:58.656849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655654    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/28f05b04-e9c8-40cc-a1a9-506eda546585-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-cnibin\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-cnibin\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-run-netns\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655741    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-host\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e4edafc-4fc3-4a62-88ee-192b71ec0606-host-slash\") pod \"iptables-alerter-nnn9b\" (UID: \"2e4edafc-4fc3-4a62-88ee-192b71ec0606\") " pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655811    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-run-netns\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/817a083d-1599-4594-acf4-4c6548882747-agent-certs\") pod \"konnectivity-agent-4pnt6\" (UID: \"817a083d-1599-4594-acf4-4c6548882747\") " pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-run-netns\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655880    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-cnibin\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-var-lib-openvswitch\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655951    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-var-lib-openvswitch\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655950    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-cnibin\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655919    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-run-netns\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.655975    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.657298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/757899f3-7ab9-4214-b494-b457ad9a8986-multus-daemon-config\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656003    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-systemd\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656036    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-tuned\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656050    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e4edafc-4fc3-4a62-88ee-192b71ec0606-iptables-alerter-script\") pod \"iptables-alerter-nnn9b\" (UID: \"2e4edafc-4fc3-4a62-88ee-192b71ec0606\") " pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rg9l\" (UniqueName: \"kubernetes.io/projected/75e411b6-ea5d-48ef-b050-3819a0dee45a-kube-api-access-9rg9l\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28f05b04-e9c8-40cc-a1a9-506eda546585-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-os-release\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-sysconfig\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-run-ovn-kubernetes\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-var-lib-cni-bin\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-var-lib-cni-multus\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656293    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-var-lib-cni-bin\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.657794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-multus-conf-dir\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656350    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-os-release\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-sysctl-d\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-run-ovn-kubernetes\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656420    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-multus-conf-dir\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j74vp\" (UniqueName: \"kubernetes.io/projected/2e4edafc-4fc3-4a62-88ee-192b71ec0606-kube-api-access-j74vp\") pod \"iptables-alerter-nnn9b\" (UID: \"2e4edafc-4fc3-4a62-88ee-192b71ec0606\") " pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656450    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/757899f3-7ab9-4214-b494-b457ad9a8986-multus-daemon-config\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656455    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-var-lib-cni-multus\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-system-cni-dir\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4557981e-bf4c-4cc2-9cf9-12fa46137668-ovn-node-metrics-cert\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656549    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28f05b04-e9c8-40cc-a1a9-506eda546585-system-cni-dir\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-var-lib-kubelet\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-hostroot\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656634    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-lib-modules\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/28f05b04-e9c8-40cc-a1a9-506eda546585-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656685    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-hostroot\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656700    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-var-lib-kubelet\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656714    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-registration-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-slash\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656764    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-etc-openvswitch\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/757899f3-7ab9-4214-b494-b457ad9a8986-cni-binary-copy\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-run-k8s-cni-cncf-io\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656812    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-host-slash\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656823    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/757899f3-7ab9-4214-b494-b457ad9a8986-host-run-k8s-cni-cncf-io\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4557981e-bf4c-4cc2-9cf9-12fa46137668-etc-openvswitch\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656841    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/428cf71a-d839-4997-9aec-614cedd0bf3d-host\") pod \"node-ca-62pn5\" (UID: \"428cf71a-d839-4997-9aec-614cedd0bf3d\") " pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4284\" (UniqueName: \"kubernetes.io/projected/428cf71a-d839-4997-9aec-614cedd0bf3d-kube-api-access-q4284\") pod \"node-ca-62pn5\" (UID: \"428cf71a-d839-4997-9aec-614cedd0bf3d\") " pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.658752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.656955    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 17:27:58.660268 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.660250    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4557981e-bf4c-4cc2-9cf9-12fa46137668-ovn-node-metrics-cert\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.666115 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.666088    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf4m2\" (UniqueName: \"kubernetes.io/projected/757899f3-7ab9-4214-b494-b457ad9a8986-kube-api-access-sf4m2\") pod \"multus-c2tqn\" (UID: \"757899f3-7ab9-4214-b494-b457ad9a8986\") " pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.666219 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.666131    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/817a083d-1599-4594-acf4-4c6548882747-agent-certs\") pod \"konnectivity-agent-4pnt6\" (UID: \"817a083d-1599-4594-acf4-4c6548882747\") " pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:27:58.667681 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.667661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rg9l\" (UniqueName: \"kubernetes.io/projected/75e411b6-ea5d-48ef-b050-3819a0dee45a-kube-api-access-9rg9l\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:27:58.668590 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.668569    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjzc8\" (UniqueName: \"kubernetes.io/projected/4557981e-bf4c-4cc2-9cf9-12fa46137668-kube-api-access-fjzc8\") pod \"ovnkube-node-qcpcg\" (UID: \"4557981e-bf4c-4cc2-9cf9-12fa46137668\") " pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.669261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.669244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x49p5\" (UniqueName: \"kubernetes.io/projected/28f05b04-e9c8-40cc-a1a9-506eda546585-kube-api-access-x49p5\") pod \"multus-additional-cni-plugins-pnrtm\" (UID: \"28f05b04-e9c8-40cc-a1a9-506eda546585\") " pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.669460 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.669428    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" event={"ID":"b91921211232e6c562c46bbcbbc9ca7e","Type":"ContainerStarted","Data":"ce657a59a2bfbb7f71e35ac8fc844227c9794ddb7044ceceb0ec2a71bfe906c3"}
Jul 09 17:27:58.670661 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.670638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" event={"ID":"a2a2dba3aa322612eb9f7051046eb689","Type":"ContainerStarted","Data":"34668ce80fabeaf8cc405900dca0f199b34263a3598d5a11247641b597333980"}
Jul 09 17:27:58.757819 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.757758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:27:58.757819 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.757794    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c6c2219-d209-4d94-a17e-5eb6baa05c02-kubelet-config\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:58.757983 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.757825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-run\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.757983 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.757882    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-run\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.757983 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.757889    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c6c2219-d209-4d94-a17e-5eb6baa05c02-kubelet-config\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:58.757983 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.757913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-sys\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.757983 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.757935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-tmp\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.757983 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.757961    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxvl\" (UniqueName: \"kubernetes.io/projected/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-kube-api-access-lxxvl\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.757986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db60da2c-6cce-408a-9bc4-923b9ea3a79f-hosts-file\") pod \"node-resolver-59fkz\" (UID: \"db60da2c-6cce-408a-9bc4-923b9ea3a79f\") " pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-kubernetes\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-var-lib-kubelet\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/428cf71a-d839-4997-9aec-614cedd0bf3d-serviceca\") pod \"node-ca-62pn5\" (UID: \"428cf71a-d839-4997-9aec-614cedd0bf3d\") " pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c6c2219-d209-4d94-a17e-5eb6baa05c02-dbus\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-socket-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758113    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db60da2c-6cce-408a-9bc4-923b9ea3a79f-hosts-file\") pod \"node-resolver-59fkz\" (UID: \"db60da2c-6cce-408a-9bc4-923b9ea3a79f\") " pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-sys-fs\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db60da2c-6cce-408a-9bc4-923b9ea3a79f-tmp-dir\") pod \"node-resolver-59fkz\" (UID: \"db60da2c-6cce-408a-9bc4-923b9ea3a79f\") " pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rdn\" (UniqueName: \"kubernetes.io/projected/4dd7133a-00c4-429b-921c-68cbaaede936-kube-api-access-86rdn\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-device-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.758293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-host\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758309    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e4edafc-4fc3-4a62-88ee-192b71ec0606-host-slash\") pod \"iptables-alerter-nnn9b\" (UID: \"2e4edafc-4fc3-4a62-88ee-192b71ec0606\") " pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-systemd\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758348    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-sys\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-tuned\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758399    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758441    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e4edafc-4fc3-4a62-88ee-192b71ec0606-iptables-alerter-script\") pod \"iptables-alerter-nnn9b\" (UID: \"2e4edafc-4fc3-4a62-88ee-192b71ec0606\") " pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-sysconfig\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-sysctl-d\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758572    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e4edafc-4fc3-4a62-88ee-192b71ec0606-host-slash\") pod \"iptables-alerter-nnn9b\" (UID: \"2e4edafc-4fc3-4a62-88ee-192b71ec0606\") " pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758593    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db60da2c-6cce-408a-9bc4-923b9ea3a79f-tmp-dir\") pod \"node-resolver-59fkz\" (UID: \"db60da2c-6cce-408a-9bc4-923b9ea3a79f\") " pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758634    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-kubernetes\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j74vp\" (UniqueName: \"kubernetes.io/projected/2e4edafc-4fc3-4a62-88ee-192b71ec0606-kube-api-access-j74vp\") pod \"iptables-alerter-nnn9b\" (UID: \"2e4edafc-4fc3-4a62-88ee-192b71ec0606\") " pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.758937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-lib-modules\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-var-lib-kubelet\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-registration-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/428cf71a-d839-4997-9aec-614cedd0bf3d-host\") pod \"node-ca-62pn5\" (UID: \"428cf71a-d839-4997-9aec-614cedd0bf3d\") " pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758759    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4284\" (UniqueName: \"kubernetes.io/projected/428cf71a-d839-4997-9aec-614cedd0bf3d-kube-api-access-q4284\") pod \"node-ca-62pn5\" (UID: \"428cf71a-d839-4997-9aec-614cedd0bf3d\") " pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4cfq\" (UniqueName: \"kubernetes.io/projected/db60da2c-6cce-408a-9bc4-923b9ea3a79f-kube-api-access-b4cfq\") pod \"node-resolver-59fkz\" (UID: \"db60da2c-6cce-408a-9bc4-923b9ea3a79f\") " pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758811    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-modprobe-d\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-sysctl-conf\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758888    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-systemd\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.758962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-sysctl-conf\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.759037    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759046    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/428cf71a-d839-4997-9aec-614cedd0bf3d-serviceca\") pod \"node-ca-62pn5\" (UID: \"428cf71a-d839-4997-9aec-614cedd0bf3d\") " pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.759131    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret podName:3c6c2219-d209-4d94-a17e-5eb6baa05c02 nodeName:}" failed. No retries permitted until 2026-07-09 17:27:59.259114342 +0000 UTC m=+3.041833705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret") pod "global-pull-secret-syncer-2d4dg" (UID: "3c6c2219-d209-4d94-a17e-5eb6baa05c02") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759167    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c6c2219-d209-4d94-a17e-5eb6baa05c02-dbus\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:58.759610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759274    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-socket-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759313    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-sys-fs\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759348    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-sysconfig\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759383    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759394    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-device-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759448    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-host\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759546    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-lib-modules\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759598    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-registration-dir\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759631    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/428cf71a-d839-4997-9aec-614cedd0bf3d-host\") pod \"node-ca-62pn5\" (UID: \"428cf71a-d839-4997-9aec-614cedd0bf3d\") " pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759648    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-sysctl-d\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4dd7133a-00c4-429b-921c-68cbaaede936-etc-selinux\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759842    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-modprobe-d\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.760246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.759854    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e4edafc-4fc3-4a62-88ee-192b71ec0606-iptables-alerter-script\") pod \"iptables-alerter-nnn9b\" (UID: \"2e4edafc-4fc3-4a62-88ee-192b71ec0606\") " pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.760748 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.760661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-tmp\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.761343 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.761324    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-etc-tuned\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.765790 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.765746    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:27:58.765790 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.765766    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:27:58.765790 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.765779    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cgkps for pod openshift-network-diagnostics/network-check-target-cmvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:27:58.766001 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:58.765830    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps podName:2a163353-3724-405a-b108-b014900a0464 nodeName:}" failed. No retries permitted until 2026-07-09 17:27:59.265814914 +0000 UTC m=+3.048534228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cgkps" (UniqueName: "kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps") pod "network-check-target-cmvcs" (UID: "2a163353-3724-405a-b108-b014900a0464") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:27:58.767033 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.766754    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j74vp\" (UniqueName: \"kubernetes.io/projected/2e4edafc-4fc3-4a62-88ee-192b71ec0606-kube-api-access-j74vp\") pod \"iptables-alerter-nnn9b\" (UID: \"2e4edafc-4fc3-4a62-88ee-192b71ec0606\") " pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.768653 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.768627    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rdn\" (UniqueName: \"kubernetes.io/projected/4dd7133a-00c4-429b-921c-68cbaaede936-kube-api-access-86rdn\") pod \"aws-ebs-csi-driver-node-pfr2t\" (UID: \"4dd7133a-00c4-429b-921c-68cbaaede936\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.768937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.768915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4284\" (UniqueName: \"kubernetes.io/projected/428cf71a-d839-4997-9aec-614cedd0bf3d-kube-api-access-q4284\") pod \"node-ca-62pn5\" (UID: \"428cf71a-d839-4997-9aec-614cedd0bf3d\") " pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.769306 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.769286    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4cfq\" (UniqueName: \"kubernetes.io/projected/db60da2c-6cce-408a-9bc4-923b9ea3a79f-kube-api-access-b4cfq\") pod \"node-resolver-59fkz\" (UID: \"db60da2c-6cce-408a-9bc4-923b9ea3a79f\") " pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.769572 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.769549    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxvl\" (UniqueName: \"kubernetes.io/projected/52f4849a-37e4-4b0f-9d9b-ac7b0095762a-kube-api-access-lxxvl\") pod \"tuned-x7dlj\" (UID: \"52f4849a-37e4-4b0f-9d9b-ac7b0095762a\") " pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.809499 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.809472    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:27:58.814617 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.814601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pnrtm"
Jul 09 17:27:58.821580 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.821555    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817a083d_1599_4594_acf4_4c6548882747.slice/crio-4842144eb7e9e5c60924f6e8b739029f6e17100b3404e7caaf40af405a52c234 WatchSource:0}: Error finding container 4842144eb7e9e5c60924f6e8b739029f6e17100b3404e7caaf40af405a52c234: Status 404 returned error can't find the container with id 4842144eb7e9e5c60924f6e8b739029f6e17100b3404e7caaf40af405a52c234
Jul 09 17:27:58.827304 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.827284    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c2tqn"
Jul 09 17:27:58.830867 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.830847    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:27:58.836459 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.836439    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-62pn5"
Jul 09 17:27:58.838409 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.838386    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757899f3_7ab9_4214_b494_b457ad9a8986.slice/crio-6209dc7219d388d34282ea1e59fd0e7df4afa2bd77b6f07fb758504382f7dcb4 WatchSource:0}: Error finding container 6209dc7219d388d34282ea1e59fd0e7df4afa2bd77b6f07fb758504382f7dcb4: Status 404 returned error can't find the container with id 6209dc7219d388d34282ea1e59fd0e7df4afa2bd77b6f07fb758504382f7dcb4
Jul 09 17:27:58.841248 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.841194    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7dlj"
Jul 09 17:27:58.842328 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.842239    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4557981e_bf4c_4cc2_9cf9_12fa46137668.slice/crio-f13d6aeab1bb9f6f4099a3a915af65b19bbb2e5122094f627b3cd353233f598a WatchSource:0}: Error finding container f13d6aeab1bb9f6f4099a3a915af65b19bbb2e5122094f627b3cd353233f598a: Status 404 returned error can't find the container with id f13d6aeab1bb9f6f4099a3a915af65b19bbb2e5122094f627b3cd353233f598a
Jul 09 17:27:58.847307 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.847280    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59fkz"
Jul 09 17:27:58.848480 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.848457    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428cf71a_d839_4997_9aec_614cedd0bf3d.slice/crio-eb6257e2e7b7cb06ee2a441cc73704939fd0792e1e61841fdcc55443ff800e9c WatchSource:0}: Error finding container eb6257e2e7b7cb06ee2a441cc73704939fd0792e1e61841fdcc55443ff800e9c: Status 404 returned error can't find the container with id eb6257e2e7b7cb06ee2a441cc73704939fd0792e1e61841fdcc55443ff800e9c
Jul 09 17:27:58.852543 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.852523    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t"
Jul 09 17:27:58.853318 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.853296    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f4849a_37e4_4b0f_9d9b_ac7b0095762a.slice/crio-7cb291ac4b4387221834045f0739dea98987ba88ef797b8d2b12a3cfba7bd9c3 WatchSource:0}: Error finding container 7cb291ac4b4387221834045f0739dea98987ba88ef797b8d2b12a3cfba7bd9c3: Status 404 returned error can't find the container with id 7cb291ac4b4387221834045f0739dea98987ba88ef797b8d2b12a3cfba7bd9c3
Jul 09 17:27:58.857998 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.857978    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnn9b"
Jul 09 17:27:58.859532 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:58.859477    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 17:27:58.862306 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.862282    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb60da2c_6cce_408a_9bc4_923b9ea3a79f.slice/crio-a56972acc74edfd57a59180bec1f1469a2c2e19f57a9c9f1af92a684e65d0714 WatchSource:0}: Error finding container a56972acc74edfd57a59180bec1f1469a2c2e19f57a9c9f1af92a684e65d0714: Status 404 returned error can't find the container with id a56972acc74edfd57a59180bec1f1469a2c2e19f57a9c9f1af92a684e65d0714
Jul 09 17:27:58.866934 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.866911    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd7133a_00c4_429b_921c_68cbaaede936.slice/crio-efd754d753d8f1bcaf8bcd09f642a17733dd4ada5832adfac68e838cfa14a072 WatchSource:0}: Error finding container efd754d753d8f1bcaf8bcd09f642a17733dd4ada5832adfac68e838cfa14a072: Status 404 returned error can't find the container with id efd754d753d8f1bcaf8bcd09f642a17733dd4ada5832adfac68e838cfa14a072
Jul 09 17:27:58.871448 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:27:58.871425    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4edafc_4fc3_4a62_88ee_192b71ec0606.slice/crio-cfbd07af21dab381a6e0c3469e64f1085dcb93e3d142fb68acae8a30f0919d95 WatchSource:0}: Error finding container cfbd07af21dab381a6e0c3469e64f1085dcb93e3d142fb68acae8a30f0919d95: Status 404 returned error can't find the container with id cfbd07af21dab381a6e0c3469e64f1085dcb93e3d142fb68acae8a30f0919d95
Jul 09 17:27:59.161625 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.161591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:27:59.161807 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.161758    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:27:59.161868 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.161831    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs podName:75e411b6-ea5d-48ef-b050-3819a0dee45a nodeName:}" failed. No retries permitted until 2026-07-09 17:28:00.161812198 +0000 UTC m=+3.944531508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs") pod "network-metrics-daemon-zln6d" (UID: "75e411b6-ea5d-48ef-b050-3819a0dee45a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:27:59.262936 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.262905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:59.263100 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.263077    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:27:59.263175 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.263154    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret podName:3c6c2219-d209-4d94-a17e-5eb6baa05c02 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:00.263136672 +0000 UTC m=+4.045855984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret") pod "global-pull-secret-syncer-2d4dg" (UID: "3c6c2219-d209-4d94-a17e-5eb6baa05c02") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:27:59.363764 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.363724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:27:59.363910 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.363892    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:27:59.363910 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.363909    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:27:59.363991 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.363919    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cgkps for pod openshift-network-diagnostics/network-check-target-cmvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:27:59.363991 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.363972    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps podName:2a163353-3724-405a-b108-b014900a0464 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:00.363954017 +0000 UTC m=+4.146673329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cgkps" (UniqueName: "kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps") pod "network-check-target-cmvcs" (UID: "2a163353-3724-405a-b108-b014900a0464") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:27:59.543542 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.543437    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:22:58 +0000 UTC" deadline="2027-12-22 06:01:56.195369169 +0000 UTC"
Jul 09 17:27:59.543542 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.543479    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12732h33m56.651894989s"
Jul 09 17:27:59.664751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.664713    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:27:59.665158 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.664724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:27:59.665158 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.664852    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:27:59.665158 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:27:59.664912    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:27:59.672949 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.672927    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7dlj" event={"ID":"52f4849a-37e4-4b0f-9d9b-ac7b0095762a","Type":"ContainerStarted","Data":"7cb291ac4b4387221834045f0739dea98987ba88ef797b8d2b12a3cfba7bd9c3"}
Jul 09 17:27:59.674143 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.674111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerStarted","Data":"f13d6aeab1bb9f6f4099a3a915af65b19bbb2e5122094f627b3cd353233f598a"}
Jul 09 17:27:59.675399 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.675374    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2tqn" event={"ID":"757899f3-7ab9-4214-b494-b457ad9a8986","Type":"ContainerStarted","Data":"6209dc7219d388d34282ea1e59fd0e7df4afa2bd77b6f07fb758504382f7dcb4"}
Jul 09 17:27:59.676432 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.676413    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" event={"ID":"28f05b04-e9c8-40cc-a1a9-506eda546585","Type":"ContainerStarted","Data":"3e63817a174aba5cdc843eb6f570db270b662dfc4aadbab6cc181c33166c53c7"}
Jul 09 17:27:59.677428 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.677409    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4pnt6" event={"ID":"817a083d-1599-4594-acf4-4c6548882747","Type":"ContainerStarted","Data":"4842144eb7e9e5c60924f6e8b739029f6e17100b3404e7caaf40af405a52c234"}
Jul 09 17:27:59.678479 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.678458    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnn9b" event={"ID":"2e4edafc-4fc3-4a62-88ee-192b71ec0606","Type":"ContainerStarted","Data":"cfbd07af21dab381a6e0c3469e64f1085dcb93e3d142fb68acae8a30f0919d95"}
Jul 09 17:27:59.679477 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.679459    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t" event={"ID":"4dd7133a-00c4-429b-921c-68cbaaede936","Type":"ContainerStarted","Data":"efd754d753d8f1bcaf8bcd09f642a17733dd4ada5832adfac68e838cfa14a072"}
Jul 09 17:27:59.680403 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.680385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59fkz" event={"ID":"db60da2c-6cce-408a-9bc4-923b9ea3a79f","Type":"ContainerStarted","Data":"a56972acc74edfd57a59180bec1f1469a2c2e19f57a9c9f1af92a684e65d0714"}
Jul 09 17:27:59.681772 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:27:59.681748    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-62pn5" event={"ID":"428cf71a-d839-4997-9aec-614cedd0bf3d","Type":"ContainerStarted","Data":"eb6257e2e7b7cb06ee2a441cc73704939fd0792e1e61841fdcc55443ff800e9c"}
Jul 09 17:28:00.170838 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:00.170801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:00.171030 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:00.170988    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:00.171094 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:00.171057    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs podName:75e411b6-ea5d-48ef-b050-3819a0dee45a nodeName:}" failed. No retries permitted until 2026-07-09 17:28:02.171037355 +0000 UTC m=+5.953756667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs") pod "network-metrics-daemon-zln6d" (UID: "75e411b6-ea5d-48ef-b050-3819a0dee45a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:00.271753 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:00.271716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:00.271968 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:00.271934    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:00.272044 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:00.272016    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret podName:3c6c2219-d209-4d94-a17e-5eb6baa05c02 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:02.271994384 +0000 UTC m=+6.054713695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret") pod "global-pull-secret-syncer-2d4dg" (UID: "3c6c2219-d209-4d94-a17e-5eb6baa05c02") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:00.372886 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:00.372848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:00.373066 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:00.373044    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:28:00.373066 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:00.373065    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:28:00.373177 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:00.373077    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cgkps for pod openshift-network-diagnostics/network-check-target-cmvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:00.373177 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:00.373140    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps podName:2a163353-3724-405a-b108-b014900a0464 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:02.373122448 +0000 UTC m=+6.155841770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cgkps" (UniqueName: "kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps") pod "network-check-target-cmvcs" (UID: "2a163353-3724-405a-b108-b014900a0464") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:00.544613 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:00.544508    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:22:58 +0000 UTC" deadline="2028-03-02 23:58:15.825822265 +0000 UTC"
Jul 09 17:28:00.544613 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:00.544570    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14454h30m15.281256538s"
Jul 09 17:28:00.665617 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:00.665426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:00.665981 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:00.665721    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:01.664126 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:01.664100    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:01.664307 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:01.664239    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:01.664627 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:01.664609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:01.664739 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:01.664721    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:01.704695 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:01.704661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" event={"ID":"b91921211232e6c562c46bbcbbc9ca7e","Type":"ContainerStarted","Data":"ca8d28e47b4f1268ceca75792d54daf586a3a4aca0d891661d8304ef1336390a"}
Jul 09 17:28:01.715554 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:01.715499    2583 generic.go:356] "Generic (PLEG): container finished" podID="a2a2dba3aa322612eb9f7051046eb689" containerID="2043848bd57915e45d93fdad4c649c9ab52f1bf1fa9cd95b7fa73ce97f00af26" exitCode=0
Jul 09 17:28:01.715554 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:01.715543    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" event={"ID":"a2a2dba3aa322612eb9f7051046eb689","Type":"ContainerDied","Data":"2043848bd57915e45d93fdad4c649c9ab52f1bf1fa9cd95b7fa73ce97f00af26"}
Jul 09 17:28:01.719452 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:01.719382    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" podStartSLOduration=4.719365069 podStartE2EDuration="4.719365069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:01.71854378 +0000 UTC m=+5.501263112" watchObservedRunningTime="2026-07-09 17:28:01.719365069 +0000 UTC m=+5.502084401"
Jul 09 17:28:02.191463 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:02.191425    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:02.191756 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:02.191618    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:02.191756 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:02.191679    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs podName:75e411b6-ea5d-48ef-b050-3819a0dee45a nodeName:}" failed. No retries permitted until 2026-07-09 17:28:06.191660616 +0000 UTC m=+9.974379927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs") pod "network-metrics-daemon-zln6d" (UID: "75e411b6-ea5d-48ef-b050-3819a0dee45a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:02.292267 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:02.292230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:02.292464 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:02.292448    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:02.292531 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:02.292515    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret podName:3c6c2219-d209-4d94-a17e-5eb6baa05c02 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:06.292495283 +0000 UTC m=+10.075214617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret") pod "global-pull-secret-syncer-2d4dg" (UID: "3c6c2219-d209-4d94-a17e-5eb6baa05c02") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:02.395619 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:02.395025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:02.395619 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:02.395177    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:28:02.395619 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:02.395211    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:28:02.395619 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:02.395225    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cgkps for pod openshift-network-diagnostics/network-check-target-cmvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:02.395619 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:02.395289    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps podName:2a163353-3724-405a-b108-b014900a0464 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:06.395268258 +0000 UTC m=+10.177987571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cgkps" (UniqueName: "kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps") pod "network-check-target-cmvcs" (UID: "2a163353-3724-405a-b108-b014900a0464") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:02.664919 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:02.664456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:02.664919 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:02.664588    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:03.665227 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:03.664902    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:03.665227 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:03.665077    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:03.665734 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:03.665487    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:03.665734 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:03.665590    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:04.664395 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:04.664299    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:04.664567 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:04.664412    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:05.664461 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:05.664427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:05.664913 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:05.664476    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:05.664913 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:05.664594    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:05.664913 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:05.664639    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:06.226818 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:06.226783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:06.227019 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:06.226981    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:06.227102 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:06.227042    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs podName:75e411b6-ea5d-48ef-b050-3819a0dee45a nodeName:}" failed. No retries permitted until 2026-07-09 17:28:14.227023342 +0000 UTC m=+18.009742666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs") pod "network-metrics-daemon-zln6d" (UID: "75e411b6-ea5d-48ef-b050-3819a0dee45a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:06.327505 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:06.327471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:06.327637 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:06.327585    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:06.327637 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:06.327634    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret podName:3c6c2219-d209-4d94-a17e-5eb6baa05c02 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:14.327621814 +0000 UTC m=+18.110341123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret") pod "global-pull-secret-syncer-2d4dg" (UID: "3c6c2219-d209-4d94-a17e-5eb6baa05c02") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:06.428001 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:06.427960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:06.428159 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:06.428138    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:28:06.428239 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:06.428169    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:28:06.428239 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:06.428185    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cgkps for pod openshift-network-diagnostics/network-check-target-cmvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:06.428344 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:06.428261    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps podName:2a163353-3724-405a-b108-b014900a0464 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:14.42824152 +0000 UTC m=+18.210960841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cgkps" (UniqueName: "kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps") pod "network-check-target-cmvcs" (UID: "2a163353-3724-405a-b108-b014900a0464") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:06.665412 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:06.665377    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:06.665843 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:06.665484    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:07.665344 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:07.664889    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:07.665344 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:07.665021    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:07.665344 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:07.665076    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:07.665344 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:07.665220    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:08.664465 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:08.664431    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:08.664648 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:08.664563    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:09.664111 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:09.664074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:09.664571 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:09.664218    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:09.664571 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:09.664076    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:09.664694 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:09.664655    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:10.664356 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.664125    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:10.664846 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:10.664467    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:10.734885 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.734855    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" event={"ID":"a2a2dba3aa322612eb9f7051046eb689","Type":"ContainerStarted","Data":"c18464926703b19834ad41c560312dc93d63871209e0e63a3bff0193677b4af9"}
Jul 09 17:28:10.736429 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.736399    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7dlj" event={"ID":"52f4849a-37e4-4b0f-9d9b-ac7b0095762a","Type":"ContainerStarted","Data":"b3c609c381475a2de11c0817d91a5047ff9531f9d39c93dfefc69692a184235f"}
Jul 09 17:28:10.738082 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.738061    2583 generic.go:356] "Generic (PLEG): container finished" podID="28f05b04-e9c8-40cc-a1a9-506eda546585" containerID="56456a24a9e1341f7e06bdde23ba58c4fce578cc7cbec10307bb3f05e68767cf" exitCode=0
Jul 09 17:28:10.738148 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.738129    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" event={"ID":"28f05b04-e9c8-40cc-a1a9-506eda546585","Type":"ContainerDied","Data":"56456a24a9e1341f7e06bdde23ba58c4fce578cc7cbec10307bb3f05e68767cf"}
Jul 09 17:28:10.739829 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.739804    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4pnt6" event={"ID":"817a083d-1599-4594-acf4-4c6548882747","Type":"ContainerStarted","Data":"9b667310e5f4ef55fd0e31f2dcfd36b0cfa32e81e9c81f4758723248bfd08a8f"}
Jul 09 17:28:10.741672 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.741645    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t" event={"ID":"4dd7133a-00c4-429b-921c-68cbaaede936","Type":"ContainerStarted","Data":"3d906900e10864895ef223aac88725f98eb28d281d361e0c6859c23c76144c4e"}
Jul 09 17:28:10.743419 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.743394    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59fkz" event={"ID":"db60da2c-6cce-408a-9bc4-923b9ea3a79f","Type":"ContainerStarted","Data":"0a4b234b08c016dbc5372449d3c8a64ce732377f125a326069b2f7a993c1b98b"}
Jul 09 17:28:10.745426 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.745392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-62pn5" event={"ID":"428cf71a-d839-4997-9aec-614cedd0bf3d","Type":"ContainerStarted","Data":"62518a14fe1d2dc2aa481fbe6399ec14e371f9511dc80458b7c1b25e8f2de303"}
Jul 09 17:28:10.769114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.769078    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x7dlj" podStartSLOduration=3.801400838 podStartE2EDuration="14.76906397s" totalImagesPullingTime="10.967663132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:10.768787706 +0000 UTC m=+14.551507050" watchObservedRunningTime="2026-07-09 17:28:10.76906397 +0000 UTC m=+14.551783302"
Jul 09 17:28:10.769284 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.769253    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" podStartSLOduration=13.769245381 podStartE2EDuration="13.769245381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:10.750997321 +0000 UTC m=+14.533716659" watchObservedRunningTime="2026-07-09 17:28:10.769245381 +0000 UTC m=+14.551964714"
Jul 09 17:28:10.778019 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.778000    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:28:10.778565 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.778542    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:28:10.783842 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.783796    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-59fkz" podStartSLOduration=3.758779967 podStartE2EDuration="14.783782205s" totalImagesPullingTime="11.025002238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:10.78322028 +0000 UTC m=+14.565939607" watchObservedRunningTime="2026-07-09 17:28:10.783782205 +0000 UTC m=+14.566501534"
Jul 09 17:28:10.797842 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.797800    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-62pn5" podStartSLOduration=3.824576931 podStartE2EDuration="14.797785051s" totalImagesPullingTime="10.97320812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:10.797708174 +0000 UTC m=+14.580427522" watchObservedRunningTime="2026-07-09 17:28:10.797785051 +0000 UTC m=+14.580504383"
Jul 09 17:28:10.812768 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:10.812732    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4pnt6" podStartSLOduration=3.834716632 podStartE2EDuration="14.81271871s" totalImagesPullingTime="10.978002078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:10.812221503 +0000 UTC m=+14.594940836" watchObservedRunningTime="2026-07-09 17:28:10.81271871 +0000 UTC m=+14.595438045"
Jul 09 17:28:11.664831 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:11.664747    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:11.664831 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:11.664773    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:11.665554 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:11.664867    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:11.665554 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:11.664945    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:11.749012 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:11.748977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnn9b" event={"ID":"2e4edafc-4fc3-4a62-88ee-192b71ec0606","Type":"ContainerStarted","Data":"acae78775fc84d5c522227f5970b4a9257d1569d4c54d5ef48fe448fe1105dd6"}
Jul 09 17:28:11.763737 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:11.763684    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nnn9b" podStartSLOduration=4.812519566 podStartE2EDuration="15.763666475s" totalImagesPullingTime="10.951146909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:11.763494346 +0000 UTC m=+15.546213678" watchObservedRunningTime="2026-07-09 17:28:11.763666475 +0000 UTC m=+15.546385811"
Jul 09 17:28:12.664342 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:12.664307    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:12.664511 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:12.664443    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:12.751056 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:12.751028    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 17:28:13.664964 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:13.664938    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:13.664964 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:13.664962    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:13.665298 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:13.665055    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:13.665298 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:13.665214    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:14.289480 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:14.289430    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:14.289938 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:14.289588    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:14.289938 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:14.289634    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs podName:75e411b6-ea5d-48ef-b050-3819a0dee45a nodeName:}" failed. No retries permitted until 2026-07-09 17:28:30.28962182 +0000 UTC m=+34.072341130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs") pod "network-metrics-daemon-zln6d" (UID: "75e411b6-ea5d-48ef-b050-3819a0dee45a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:14.389983 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:14.389954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:14.390125 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:14.390058    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:14.390125 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:14.390105    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret podName:3c6c2219-d209-4d94-a17e-5eb6baa05c02 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:30.390092182 +0000 UTC m=+34.172811491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret") pod "global-pull-secret-syncer-2d4dg" (UID: "3c6c2219-d209-4d94-a17e-5eb6baa05c02") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:14.490947 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:14.490917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:14.491087 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:14.491063    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:28:14.491087 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:14.491086    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:28:14.491165 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:14.491100    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cgkps for pod openshift-network-diagnostics/network-check-target-cmvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:14.491165 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:14.491161    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps podName:2a163353-3724-405a-b108-b014900a0464 nodeName:}" failed. No retries permitted until 2026-07-09 17:28:30.491141824 +0000 UTC m=+34.273861137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cgkps" (UniqueName: "kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps") pod "network-check-target-cmvcs" (UID: "2a163353-3724-405a-b108-b014900a0464") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:14.664479 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:14.664446    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:14.664627 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:14.664583    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:15.665249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:15.665007    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:15.665716 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:15.665058    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:15.665716 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:15.665379    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:15.665716 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:15.665443    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:16.665629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:16.665597    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:16.666001 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:16.665700    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:17.664414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:17.664380    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:17.664579 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:17.664427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:17.664579 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:17.664501    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:17.664703 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:17.664627    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:18.665119 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:18.665088    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:18.665624 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:18.665234    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:19.664764 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:19.664738    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:19.664894 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:19.664841    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:19.664894 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:19.664879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:19.664963 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:19.664936    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:20.664403 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:20.664369    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:20.664930 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:20.664488    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:20.984954 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:20.984872    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:28:20.985110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:20.985005    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 17:28:20.985742 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:20.985720    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4pnt6"
Jul 09 17:28:21.061719 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.061675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:21.152404 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.152369    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:21.453215 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.453175    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 17:28:21.620705 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.620632    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T17:28:21.453210199Z","UUID":"8f2e24f4-3f34-4230-8661-018210faa3bc","Handler":null,"Name":"","Endpoint":""}
Jul 09 17:28:21.622118 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.622100    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 17:28:21.622216 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.622140    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 17:28:21.664831 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.664739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:21.665155 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.664801    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:21.665155 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:21.665012    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:21.665155 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:21.664900    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:21.770550 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.770524    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t" event={"ID":"4dd7133a-00c4-429b-921c-68cbaaede936","Type":"ContainerStarted","Data":"50ea728e989c5b65d6fddf692e9d16a97745edf628d92e1c52f6e30735c10144"}
Jul 09 17:28:21.774087 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.774072    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:28:21.774511 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.774491    2583 generic.go:356] "Generic (PLEG): container finished" podID="4557981e-bf4c-4cc2-9cf9-12fa46137668" containerID="0b7353a2558d2cd6f2b8fdc98567db546738c84b7076810c7c4b8129a48f5271" exitCode=1
Jul 09 17:28:21.774604 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.774562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerStarted","Data":"40087ebb89943d959a1eca2996f0fc1f1e88e9a6a0ee28ee9038cc69e5561b4d"}
Jul 09 17:28:21.774651 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.774628    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerStarted","Data":"a654ee6ee8b0d836ec60835b1247dab1e6b18e2b631612c1307dd44ff921cc31"}
Jul 09 17:28:21.774682 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.774660    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerDied","Data":"0b7353a2558d2cd6f2b8fdc98567db546738c84b7076810c7c4b8129a48f5271"}
Jul 09 17:28:21.774720 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.774705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerStarted","Data":"f16ab7d017c6b6526afe5e8a013c3023469e1dd5aa48f728b988aac62f3d0097"}
Jul 09 17:28:21.776076 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.776053    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c2tqn" event={"ID":"757899f3-7ab9-4214-b494-b457ad9a8986","Type":"ContainerStarted","Data":"e52722376515a7f43875e152c34c19ca56460c58cc26dc5e5aa8d28d65e3028c"}
Jul 09 17:28:21.777790 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.777771    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" event={"ID":"28f05b04-e9c8-40cc-a1a9-506eda546585","Type":"ContainerStarted","Data":"5f805c28a34d3c6ebef6321ca0d44fd52e64c86b6c2c14244f5ddc093e297929"}
Jul 09 17:28:21.792378 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.792340    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c2tqn" podStartSLOduration=4.975430998 podStartE2EDuration="25.792327108s" totalImagesPullingTime="20.81689611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:21.791619801 +0000 UTC m=+25.574339132" watchObservedRunningTime="2026-07-09 17:28:21.792327108 +0000 UTC m=+25.575046440"
Jul 09 17:28:21.911336 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:21.911305    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:22.012082 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.012034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:22.288408 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.288377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:22.342211 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.342168    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:22.664437 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.664405    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:22.664620 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:22.664499    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:22.782659 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.782640    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:28:22.783248 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.782998    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerStarted","Data":"2f8b55ceaea1f67c9a7acfddc8d0a51c2d3d87ddbeca10133d4bc0935a5ef63a"}
Jul 09 17:28:22.783248 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.783076    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerStarted","Data":"733e4374c695a290f758cb793aca5a35b99ed1da0bada521c9b1fc1933d63ee2"}
Jul 09 17:28:22.784880 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.784858    2583 generic.go:356] "Generic (PLEG): container finished" podID="28f05b04-e9c8-40cc-a1a9-506eda546585" containerID="5f805c28a34d3c6ebef6321ca0d44fd52e64c86b6c2c14244f5ddc093e297929" exitCode=0
Jul 09 17:28:22.784965 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.784941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" event={"ID":"28f05b04-e9c8-40cc-a1a9-506eda546585","Type":"ContainerDied","Data":"5f805c28a34d3c6ebef6321ca0d44fd52e64c86b6c2c14244f5ddc093e297929"}
Jul 09 17:28:22.884252 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.884224    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:22.941451 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:22.941397    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:23.261402 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:23.261335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:23.314330 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:23.314301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:23.664756 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:23.664732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:23.664982 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:23.664732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:23.664982 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:23.664830    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:23.664982 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:23.664893    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:23.724434 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:23.724411    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:23.788312 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:23.788289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t" event={"ID":"4dd7133a-00c4-429b-921c-68cbaaede936","Type":"ContainerStarted","Data":"8132899fde6a56ad615167bfb4bb13525637105fa94866286212393ac6a5ef10"}
Jul 09 17:28:23.804625 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:23.804587    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pfr2t" podStartSLOduration=6.004725273 podStartE2EDuration="27.804571985s" totalImagesPullingTime="21.799846712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:23.803833318 +0000 UTC m=+27.586552648" watchObservedRunningTime="2026-07-09 17:28:23.804571985 +0000 UTC m=+27.587291315"
Jul 09 17:28:23.807607 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:23.807577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:24.664171 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:24.664141    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:24.664306 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:24.664245    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:24.792008 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:24.791945    2583 generic.go:356] "Generic (PLEG): container finished" podID="28f05b04-e9c8-40cc-a1a9-506eda546585" containerID="031f47d129e98d6b22bd18001316f98fb2a862c83e00c19b189b414c21411010" exitCode=0
Jul 09 17:28:24.792467 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:24.792029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" event={"ID":"28f05b04-e9c8-40cc-a1a9-506eda546585","Type":"ContainerDied","Data":"031f47d129e98d6b22bd18001316f98fb2a862c83e00c19b189b414c21411010"}
Jul 09 17:28:24.795117 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:24.795101    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:28:24.795503 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:24.795483    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerStarted","Data":"e448e7c202670c3b6344f628fd60338e2fd48b37fe10c5c61d113db627a83d85"}
Jul 09 17:28:25.664839 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:25.664811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:25.664992 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:25.664811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:25.664992 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:25.664913    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:25.664992 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:25.664979    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:26.665550 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:26.665400    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:26.665988 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:26.665601    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:26.802036 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:26.802013    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:28:26.802372 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:26.802349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerStarted","Data":"c86af3effda410bac67f70c826ead2bce7e6344c206763131462c1611711b426"}
Jul 09 17:28:26.802593 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:26.802567    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:28:26.802736 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:26.802717    2583 scope.go:117] "RemoveContainer" containerID="0b7353a2558d2cd6f2b8fdc98567db546738c84b7076810c7c4b8129a48f5271"
Jul 09 17:28:26.804619 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:26.804595    2583 generic.go:356] "Generic (PLEG): container finished" podID="28f05b04-e9c8-40cc-a1a9-506eda546585" containerID="c4f2cfac94c82d22c745f42cbbaaa932c80a45e641666d869c71fe6d4edf8a2e" exitCode=0
Jul 09 17:28:26.804716 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:26.804642    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" event={"ID":"28f05b04-e9c8-40cc-a1a9-506eda546585","Type":"ContainerDied","Data":"c4f2cfac94c82d22c745f42cbbaaa932c80a45e641666d869c71fe6d4edf8a2e"}
Jul 09 17:28:26.819914 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:26.819896    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:28:27.676938 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:27.676907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:27.677412 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:27.677022    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:27.677412 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:27.676911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:27.677412 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:27.677158    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:27.811720 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:27.811692    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:28:27.812090 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:27.812061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" event={"ID":"4557981e-bf4c-4cc2-9cf9-12fa46137668","Type":"ContainerStarted","Data":"9db8ff3a20e23f60f55f1c56052e4a988cc975bca5ccd4fe4702942d278fb697"}
Jul 09 17:28:27.812399 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:27.812279    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:28:27.812399 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:27.812401    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:28:27.829449 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:27.829424    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:28:27.840320 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:27.840278    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg" podStartSLOduration=9.394340188 podStartE2EDuration="31.840263704s" totalImagesPullingTime="22.445923516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:27.839850005 +0000 UTC m=+31.622569337" watchObservedRunningTime="2026-07-09 17:28:27.840263704 +0000 UTC m=+31.622983065"
Jul 09 17:28:28.376067 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:28.375875    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmvcs"]
Jul 09 17:28:28.376240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:28.376189    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:28.376315 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:28.376291    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:28.378668 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:28.378644    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2d4dg"]
Jul 09 17:28:28.378804 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:28.378741    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:28.378881 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:28.378832    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:28.379520 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:28.379497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zln6d"]
Jul 09 17:28:28.379649 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:28.379597    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:28.379710 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:28.379690    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:29.375116 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:29.375084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:29.444944 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:29.444907    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:29.548055 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:29.548023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:29.648535 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:29.648446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:29.664122 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:29.664098    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:29.664272 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:29.664250    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:29.888880 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:29.888844    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:29.959489 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:29.959401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:30.060248 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.060214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:30.161864 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.161832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:30.307979 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.307945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:30.308133 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.308072    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:30.308189 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.308136    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs podName:75e411b6-ea5d-48ef-b050-3819a0dee45a nodeName:}" failed. No retries permitted until 2026-07-09 17:29:02.308118551 +0000 UTC m=+66.090837860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs") pod "network-metrics-daemon-zln6d" (UID: "75e411b6-ea5d-48ef-b050-3819a0dee45a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 17:28:30.408802 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.408771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:30.409172 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.408935    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:30.409172 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.409013    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret podName:3c6c2219-d209-4d94-a17e-5eb6baa05c02 nodeName:}" failed. No retries permitted until 2026-07-09 17:29:02.408993099 +0000 UTC m=+66.191712408 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret") pod "global-pull-secret-syncer-2d4dg" (UID: "3c6c2219-d209-4d94-a17e-5eb6baa05c02") : object "kube-system"/"original-pull-secret" not registered
Jul 09 17:28:30.509401 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.509365    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:30.509526 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.509491    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 17:28:30.509526 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.509508    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 17:28:30.509526 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.509517    2583 projected.go:196] Error preparing data for projected volume kube-api-access-cgkps for pod openshift-network-diagnostics/network-check-target-cmvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:30.509638 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.509568    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps podName:2a163353-3724-405a-b108-b014900a0464 nodeName:}" failed. No retries permitted until 2026-07-09 17:29:02.509553587 +0000 UTC m=+66.292272896 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cgkps" (UniqueName: "kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps") pod "network-check-target-cmvcs" (UID: "2a163353-3724-405a-b108-b014900a0464") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 17:28:30.664546 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.664519    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:30.664714 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.664647    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:30.664714 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.664688    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:30.664821 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:30.664780    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:30.776658 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.776624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:30.838420 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.838388    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:30.870312 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:30.870289    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59fkz_db60da2c-6cce-408a-9bc4-923b9ea3a79f/dns-node-resolver/0.log"
Jul 09 17:28:31.045985 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:31.045953    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:31.107559 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:31.107494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:31.511368 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:31.511340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:31.611763 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:31.611725    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:31.664808 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:31.664783    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:31.664974 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:31.664882    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:31.869474 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:31.869453    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-62pn5_428cf71a-d839-4997-9aec-614cedd0bf3d/node-ca/0.log"
Jul 09 17:28:31.968023 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:31.967992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:32.457415 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:32.457388    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:32.560079 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:32.560012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:32.664309 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:32.664284    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:32.664421 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:32.664400    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:32.664464 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:32.664437    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:32.664542 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:32.664527    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:32.828039 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:32.828008    2583 generic.go:356] "Generic (PLEG): container finished" podID="28f05b04-e9c8-40cc-a1a9-506eda546585" containerID="f8758eae4b3c71d7be2ccc115eeea749f07523099d124d7efb4a8262291a832a" exitCode=0
Jul 09 17:28:32.828185 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:32.828050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" event={"ID":"28f05b04-e9c8-40cc-a1a9-506eda546585","Type":"ContainerDied","Data":"f8758eae4b3c71d7be2ccc115eeea749f07523099d124d7efb4a8262291a832a"}
Jul 09 17:28:33.115711 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:33.115660    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:33.172412 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:33.172386    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:33.664755 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:33.664725    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:33.665115 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:33.664818    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2d4dg" podUID="3c6c2219-d209-4d94-a17e-5eb6baa05c02"
Jul 09 17:28:33.832845 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:33.832818    2583 generic.go:356] "Generic (PLEG): container finished" podID="28f05b04-e9c8-40cc-a1a9-506eda546585" containerID="13c2cddca0240fb845f45dd1cb18940f38585e51296a08263c0aee87458d809d" exitCode=0
Jul 09 17:28:33.832963 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:33.832863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" event={"ID":"28f05b04-e9c8-40cc-a1a9-506eda546585","Type":"ContainerDied","Data":"13c2cddca0240fb845f45dd1cb18940f38585e51296a08263c0aee87458d809d"}
Jul 09 17:28:34.337598 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:34.337567    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:34.664773 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:34.664691    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:34.664773 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:34.664730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:34.665319 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:34.664833    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zln6d" podUID="75e411b6-ea5d-48ef-b050-3819a0dee45a"
Jul 09 17:28:34.665319 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:34.664936    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvcs" podUID="2a163353-3724-405a-b108-b014900a0464"
Jul 09 17:28:34.772098 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:34.772067    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:34.838483 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:34.838447    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" event={"ID":"28f05b04-e9c8-40cc-a1a9-506eda546585","Type":"ContainerStarted","Data":"ec80315c2fbfefb96655ee89ad4aebc333ab7d9c26020251e24b85f9e34c7dbb"}
Jul 09 17:28:34.864008 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:34.863963    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pnrtm" podStartSLOduration=8.875679001 podStartE2EDuration="38.863947812s" totalImagesPullingTime="29.988268811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:34.862254214 +0000 UTC m=+38.644973544" watchObservedRunningTime="2026-07-09 17:28:34.863947812 +0000 UTC m=+38.646667142"
Jul 09 17:28:34.899983 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:34.899959    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:34.996642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:34.996583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:35.009959 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:35.009940    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeReady"
Jul 09 17:28:35.010047 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:35.010036    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 17:28:35.172644 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:35.172619    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:35.273086 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:35.273025    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:35.468261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:35.468235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:35.664679 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:35.664660    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:28:35.667592 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:35.667578    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 17:28:36.269608 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:36.269575    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:36.664913 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:36.664752    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:28:36.665065 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:36.664806    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:28:36.669500 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:36.669471    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 17:28:36.669840 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:36.669606    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 17:28:36.670811 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:36.670788    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ls9tf\""
Jul 09 17:28:36.670935 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:36.670838    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8889q\""
Jul 09 17:28:36.670935 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:36.670848    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 17:28:36.875670 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:36.875647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:37.069180 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:37.069105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:37.275291 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:37.275234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:37.404428 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:37.404406    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:37.673338 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:37.673281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:37.737566 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:37.737528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:38.267391 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:38.267320    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:38.469460 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:38.469430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:38.620448 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:38.620418    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:38.722036 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:38.722012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:39.064629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:39.064552    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:39.116629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:39.116603    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:39.268435 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:39.268415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:39.666043 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:39.666006    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:40.465104 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:40.465066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:40.571101 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:40.571072    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:40.672216 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:40.672180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:41.068184 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:41.068153    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:41.220817 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:41.220787    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:41.322351 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:41.322292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:41.472255 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:41.472187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:42.467619 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:42.467587    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:42.670776 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:42.670749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:42.863988 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:42.863952    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:43.091192 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:43.091154    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:43.272422 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:43.272333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:43.863113 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:43.863062    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:44.065345 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:44.065299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:44.166022 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:44.165953    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:44.217248 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:44.217220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:44.464952 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:44.464885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:44.869501 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:44.869468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:45.268329 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:45.268239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:45.474038 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:45.474006    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:48.407796 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:48.407769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:48.458132 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:48.458109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:50.937687 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:50.937648    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:51.038101 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:51.038064    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:51.481225 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:51.481171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:51.558297 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:51.558267    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:51.744691 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:51.744617    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:51.843319 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:51.843291    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:51.897623 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:51.897598    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:52.045978 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:52.045909    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:52.146928 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:52.146902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:52.262941 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:52.262918    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:52.323300 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:52.323244    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:52.460339 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:52.460311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:52.514945 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:52.514923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:53.250277 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.250238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:53.445133 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.445069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:53.546316 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.546241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:53.889256 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.889230    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69658864c6-m728d"]
Jul 09 17:28:53.892798 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.892780    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:53.896085 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.896056    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 17:28:53.896190 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.896086    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 17:28:53.896190 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.896100    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 17:28:53.896190 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.896140    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6m8jk\""
Jul 09 17:28:53.903607 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.903583    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 17:28:53.905919 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.905897    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69658864c6-m728d"]
Jul 09 17:28:53.948803 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.948782    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kbmjn"]
Jul 09 17:28:53.951044 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.951030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:53.954147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.954129    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 17:28:53.954147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.954142    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 17:28:53.954324 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.954212    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gmgfn\""
Jul 09 17:28:53.963877 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.963857    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kbmjn"]
Jul 09 17:28:53.966371 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.966351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-ca-trust-extracted\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:53.966512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.966400    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-tls\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:53.966512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.966451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-trusted-ca\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:53.966609 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.966512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-bound-sa-token\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:53.966609 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.966550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-image-registry-private-configuration\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:53.966609 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.966579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-certificates\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:53.966767 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.966628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-installation-pull-secrets\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:53.966767 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.966703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thkdl\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-kube-api-access-thkdl\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:53.978039 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.978013    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69658864c6-m728d"]
Jul 09 17:28:53.978179 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:28:53.978160    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-thkdl registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-69658864c6-m728d" podUID="cea9a71e-8f38-416d-9ebe-84ffc4db8b85"
Jul 09 17:28:53.980373 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.980355    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mm4v5"]
Jul 09 17:28:53.982728 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.982714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:53.985959 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.985909    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 17:28:53.986112 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.986096    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gxngq\""
Jul 09 17:28:53.986174 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.986098    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 17:28:53.986389 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.986374    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 17:28:53.986611 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.986598    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 17:28:53.998692 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:53.998673    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mm4v5"]
Jul 09 17:28:54.053480 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.053461    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"]
Jul 09 17:28:54.055728 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.055715    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"
Jul 09 17:28:54.067709 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067689    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-bound-sa-token\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.067802 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47f6b04e-8b09-4796-82bb-e4627482008b-config-volume\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.067802 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067750    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4551c739-ce40-4612-98a8-a498cc87b5db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.067802 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-image-registry-private-configuration\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.067954 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-certificates\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.067954 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067840    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-installation-pull-secrets\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.067954 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47f6b04e-8b09-4796-82bb-e4627482008b-metrics-tls\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.067954 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067893    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47f6b04e-8b09-4796-82bb-e4627482008b-tmp-dir\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.067954 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4551c739-ce40-4612-98a8-a498cc87b5db-crio-socket\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.068118 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.067965    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkzd9\" (UniqueName: \"kubernetes.io/projected/47f6b04e-8b09-4796-82bb-e4627482008b-kube-api-access-qkzd9\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.068118 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.068009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thkdl\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-kube-api-access-thkdl\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.068118 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.068037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-ca-trust-extracted\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.068118 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.068096    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4551c739-ce40-4612-98a8-a498cc87b5db-data-volume\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.068313 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.068149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-tls\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.068313 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.068180    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4551c739-ce40-4612-98a8-a498cc87b5db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.068313 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.068232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-trusted-ca\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.068313 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.068266    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78sx7\" (UniqueName: \"kubernetes.io/projected/4551c739-ce40-4612-98a8-a498cc87b5db-kube-api-access-78sx7\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.068515 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.068399    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-ca-trust-extracted\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.068725 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.068708    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-certificates\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.069075 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.069053    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-trusted-ca\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.071720 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.071704    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-installation-pull-secrets\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.071797 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.071738    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-image-registry-private-configuration\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.071837 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.071812    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-tls\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.075362 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.075312    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 17:28:54.075612 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.075596    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xdnjw\""
Jul 09 17:28:54.076280 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.076259    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tft5v"]
Jul 09 17:28:54.079652 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.079635    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"]
Jul 09 17:28:54.079756 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.079740    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tft5v"
Jul 09 17:28:54.082277 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.082258    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-gwcbw"]
Jul 09 17:28:54.082357 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.082335    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.084878 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.084860    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-gwcbw"
Jul 09 17:28:54.085754 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.085738    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 17:28:54.088847 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.088828    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 17:28:54.096181 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.096087    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 17:28:54.097236 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.097220    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z9xhd\""
Jul 09 17:28:54.097325 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.097250    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 17:28:54.097711 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.097696    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pph5x\""
Jul 09 17:28:54.099625 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.099606    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:54.099789 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.099763    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thkdl\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-kube-api-access-thkdl\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.101693 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.101676    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 17:28:54.105074 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.105057    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-bound-sa-token\") pod \"image-registry-69658864c6-m728d\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") " pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.111145 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.111126    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"]
Jul 09 17:28:54.127998 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.127975    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-gwcbw"]
Jul 09 17:28:54.128675 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.128654    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"]
Jul 09 17:28:54.129662 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.129630    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tft5v"]
Jul 09 17:28:54.168519 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ace96505-87af-4160-92b0-8fe2e52caa57-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7v978\" (UID: \"ace96505-87af-4160-92b0-8fe2e52caa57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"
Jul 09 17:28:54.168519 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27nv5\" (UniqueName: \"kubernetes.io/projected/91301d75-2ad2-455d-bf20-237cd3d050d0-kube-api-access-27nv5\") pod \"ingress-canary-tft5v\" (UID: \"91301d75-2ad2-455d-bf20-237cd3d050d0\") " pod="openshift-ingress-canary/ingress-canary-tft5v"
Jul 09 17:28:54.168629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168537    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0579787e-b1f9-47a1-9676-9b90f869bb1e-registry-tls\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.168629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0579787e-b1f9-47a1-9676-9b90f869bb1e-trusted-ca\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.168629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91301d75-2ad2-455d-bf20-237cd3d050d0-cert\") pod \"ingress-canary-tft5v\" (UID: \"91301d75-2ad2-455d-bf20-237cd3d050d0\") " pod="openshift-ingress-canary/ingress-canary-tft5v"
Jul 09 17:28:54.168721 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0579787e-b1f9-47a1-9676-9b90f869bb1e-installation-pull-secrets\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.168721 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168645    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0579787e-b1f9-47a1-9676-9b90f869bb1e-bound-sa-token\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.168721 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0579787e-b1f9-47a1-9676-9b90f869bb1e-image-registry-private-configuration\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.168721 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47f6b04e-8b09-4796-82bb-e4627482008b-config-volume\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.168836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0579787e-b1f9-47a1-9676-9b90f869bb1e-registry-certificates\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.168836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47f6b04e-8b09-4796-82bb-e4627482008b-metrics-tls\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.168913 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168840    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47f6b04e-8b09-4796-82bb-e4627482008b-tmp-dir\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.168913 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4551c739-ce40-4612-98a8-a498cc87b5db-crio-socket\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.168913 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168871    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx8xx\" (UniqueName: \"kubernetes.io/projected/0579787e-b1f9-47a1-9676-9b90f869bb1e-kube-api-access-fx8xx\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.168913 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkzd9\" (UniqueName: \"kubernetes.io/projected/47f6b04e-8b09-4796-82bb-e4627482008b-kube-api-access-qkzd9\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.169097 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4551c739-ce40-4612-98a8-a498cc87b5db-data-volume\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.169097 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0579787e-b1f9-47a1-9676-9b90f869bb1e-ca-trust-extracted\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.169097 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168949    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4551c739-ce40-4612-98a8-a498cc87b5db-crio-socket\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.169097 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.168984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4551c739-ce40-4612-98a8-a498cc87b5db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.169097 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.169008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78sx7\" (UniqueName: \"kubernetes.io/projected/4551c739-ce40-4612-98a8-a498cc87b5db-kube-api-access-78sx7\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.169097 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.169044    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4551c739-ce40-4612-98a8-a498cc87b5db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.169097 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.169071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64pzw\" (UniqueName: \"kubernetes.io/projected/b76ff92a-a229-4bc9-8e47-bd6874831f96-kube-api-access-64pzw\") pod \"downloads-68c9cbb497-gwcbw\" (UID: \"b76ff92a-a229-4bc9-8e47-bd6874831f96\") " pod="openshift-console/downloads-68c9cbb497-gwcbw"
Jul 09 17:28:54.169451 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.169139    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47f6b04e-8b09-4796-82bb-e4627482008b-tmp-dir\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.169451 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.169289    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47f6b04e-8b09-4796-82bb-e4627482008b-config-volume\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.169701 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.169676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4551c739-ce40-4612-98a8-a498cc87b5db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.169791 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.169726    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4551c739-ce40-4612-98a8-a498cc87b5db-data-volume\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.170966 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.170943    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47f6b04e-8b09-4796-82bb-e4627482008b-metrics-tls\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.171762 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.171746    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4551c739-ce40-4612-98a8-a498cc87b5db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.185624 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.185603    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkzd9\" (UniqueName: \"kubernetes.io/projected/47f6b04e-8b09-4796-82bb-e4627482008b-kube-api-access-qkzd9\") pod \"dns-default-kbmjn\" (UID: \"47f6b04e-8b09-4796-82bb-e4627482008b\") " pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.186432 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.186413    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78sx7\" (UniqueName: \"kubernetes.io/projected/4551c739-ce40-4612-98a8-a498cc87b5db-kube-api-access-78sx7\") pod \"insights-runtime-extractor-mm4v5\" (UID: \"4551c739-ce40-4612-98a8-a498cc87b5db\") " pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.206680 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.206650    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:54.259455 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.259431    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:28:54.270327 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91301d75-2ad2-455d-bf20-237cd3d050d0-cert\") pod \"ingress-canary-tft5v\" (UID: \"91301d75-2ad2-455d-bf20-237cd3d050d0\") " pod="openshift-ingress-canary/ingress-canary-tft5v"
Jul 09 17:28:54.270434 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0579787e-b1f9-47a1-9676-9b90f869bb1e-installation-pull-secrets\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.270434 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0579787e-b1f9-47a1-9676-9b90f869bb1e-bound-sa-token\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.270434 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0579787e-b1f9-47a1-9676-9b90f869bb1e-image-registry-private-configuration\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.270434 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270421    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0579787e-b1f9-47a1-9676-9b90f869bb1e-registry-certificates\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.270633 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx8xx\" (UniqueName: \"kubernetes.io/projected/0579787e-b1f9-47a1-9676-9b90f869bb1e-kube-api-access-fx8xx\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.270633 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0579787e-b1f9-47a1-9676-9b90f869bb1e-ca-trust-extracted\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.270633 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64pzw\" (UniqueName: \"kubernetes.io/projected/b76ff92a-a229-4bc9-8e47-bd6874831f96-kube-api-access-64pzw\") pod \"downloads-68c9cbb497-gwcbw\" (UID: \"b76ff92a-a229-4bc9-8e47-bd6874831f96\") " pod="openshift-console/downloads-68c9cbb497-gwcbw"
Jul 09 17:28:54.270779 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270632    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ace96505-87af-4160-92b0-8fe2e52caa57-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7v978\" (UID: \"ace96505-87af-4160-92b0-8fe2e52caa57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"
Jul 09 17:28:54.270779 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27nv5\" (UniqueName: \"kubernetes.io/projected/91301d75-2ad2-455d-bf20-237cd3d050d0-kube-api-access-27nv5\") pod \"ingress-canary-tft5v\" (UID: \"91301d75-2ad2-455d-bf20-237cd3d050d0\") " pod="openshift-ingress-canary/ingress-canary-tft5v"
Jul 09 17:28:54.270779 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0579787e-b1f9-47a1-9676-9b90f869bb1e-registry-tls\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.270779 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.270760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0579787e-b1f9-47a1-9676-9b90f869bb1e-trusted-ca\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.271407 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.271356    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0579787e-b1f9-47a1-9676-9b90f869bb1e-registry-certificates\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.271407 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.271352    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0579787e-b1f9-47a1-9676-9b90f869bb1e-ca-trust-extracted\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.271911 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.271885    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0579787e-b1f9-47a1-9676-9b90f869bb1e-trusted-ca\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.273107 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.273076    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0579787e-b1f9-47a1-9676-9b90f869bb1e-image-registry-private-configuration\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.273220 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.273162    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91301d75-2ad2-455d-bf20-237cd3d050d0-cert\") pod \"ingress-canary-tft5v\" (UID: \"91301d75-2ad2-455d-bf20-237cd3d050d0\") " pod="openshift-ingress-canary/ingress-canary-tft5v"
Jul 09 17:28:54.273426 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.273408    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0579787e-b1f9-47a1-9676-9b90f869bb1e-registry-tls\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.273514 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.273491    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ace96505-87af-4160-92b0-8fe2e52caa57-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7v978\" (UID: \"ace96505-87af-4160-92b0-8fe2e52caa57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"
Jul 09 17:28:54.274350 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.274335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0579787e-b1f9-47a1-9676-9b90f869bb1e-installation-pull-secrets\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.281763 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.281742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0579787e-b1f9-47a1-9676-9b90f869bb1e-bound-sa-token\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.282061 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.282033    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27nv5\" (UniqueName: \"kubernetes.io/projected/91301d75-2ad2-455d-bf20-237cd3d050d0-kube-api-access-27nv5\") pod \"ingress-canary-tft5v\" (UID: \"91301d75-2ad2-455d-bf20-237cd3d050d0\") " pod="openshift-ingress-canary/ingress-canary-tft5v"
Jul 09 17:28:54.282375 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.282356    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx8xx\" (UniqueName: \"kubernetes.io/projected/0579787e-b1f9-47a1-9676-9b90f869bb1e-kube-api-access-fx8xx\") pod \"image-registry-6d7cb5cb77-b5vb7\" (UID: \"0579787e-b1f9-47a1-9676-9b90f869bb1e\") " pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.282483 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.282468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64pzw\" (UniqueName: \"kubernetes.io/projected/b76ff92a-a229-4bc9-8e47-bd6874831f96-kube-api-access-64pzw\") pod \"downloads-68c9cbb497-gwcbw\" (UID: \"b76ff92a-a229-4bc9-8e47-bd6874831f96\") " pod="openshift-console/downloads-68c9cbb497-gwcbw"
Jul 09 17:28:54.291195 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.291176    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mm4v5"
Jul 09 17:28:54.308112 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.308084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:54.362938 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.362840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"
Jul 09 17:28:54.388948 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.388913    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tft5v"
Jul 09 17:28:54.393814 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.393770    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.398480 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.398462    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-gwcbw"
Jul 09 17:28:54.402242 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.402020    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kbmjn"]
Jul 09 17:28:54.407611 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.407398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:54.428592 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.428261    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mm4v5"]
Jul 09 17:28:54.471454 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.470963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:54.527934 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.527839    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"]
Jul 09 17:28:54.530518 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:28:54.530488    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace96505_87af_4160_92b0_8fe2e52caa57.slice/crio-e26b8bd7ea227a0993deb9eaa1bd9db4f2836a379710d4964ee6ac6ecfbe9b41 WatchSource:0}: Error finding container e26b8bd7ea227a0993deb9eaa1bd9db4f2836a379710d4964ee6ac6ecfbe9b41: Status 404 returned error can't find the container with id e26b8bd7ea227a0993deb9eaa1bd9db4f2836a379710d4964ee6ac6ecfbe9b41
Jul 09 17:28:54.559223 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.559184    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tft5v"]
Jul 09 17:28:54.562155 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:28:54.562128    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91301d75_2ad2_455d_bf20_237cd3d050d0.slice/crio-be38a4b3443555ff38fd758d4d255458f2a94da37c3377aec0690a59291d4100 WatchSource:0}: Error finding container be38a4b3443555ff38fd758d4d255458f2a94da37c3377aec0690a59291d4100: Status 404 returned error can't find the container with id be38a4b3443555ff38fd758d4d255458f2a94da37c3377aec0690a59291d4100
Jul 09 17:28:54.570361 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.570339    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"]
Jul 09 17:28:54.573116 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:28:54.573094    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0579787e_b1f9_47a1_9676_9b90f869bb1e.slice/crio-06990df6a6aadcd819b7a977d9c81d6c96bfae982061e6b9ef15a7047b952f85 WatchSource:0}: Error finding container 06990df6a6aadcd819b7a977d9c81d6c96bfae982061e6b9ef15a7047b952f85: Status 404 returned error can't find the container with id 06990df6a6aadcd819b7a977d9c81d6c96bfae982061e6b9ef15a7047b952f85
Jul 09 17:28:54.581841 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.581817    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-gwcbw"]
Jul 09 17:28:54.584951 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:28:54.584931    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76ff92a_a229_4bc9_8e47_bd6874831f96.slice/crio-5815a3bee76997d227b5c5cbb7c6d68490fd058a6f7aeaf66c2a6f9aede7fd65 WatchSource:0}: Error finding container 5815a3bee76997d227b5c5cbb7c6d68490fd058a6f7aeaf66c2a6f9aede7fd65: Status 404 returned error can't find the container with id 5815a3bee76997d227b5c5cbb7c6d68490fd058a6f7aeaf66c2a6f9aede7fd65
Jul 09 17:28:54.884600 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.884563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7" event={"ID":"0579787e-b1f9-47a1-9676-9b90f869bb1e","Type":"ContainerStarted","Data":"6786580635ce1d64838f0e4d333304d3d40841237f43081447be57f054df7ff7"}
Jul 09 17:28:54.884774 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.884621    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7" event={"ID":"0579787e-b1f9-47a1-9676-9b90f869bb1e","Type":"ContainerStarted","Data":"06990df6a6aadcd819b7a977d9c81d6c96bfae982061e6b9ef15a7047b952f85"}
Jul 09 17:28:54.884774 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.884662    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:28:54.886212 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.886166    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tft5v" event={"ID":"91301d75-2ad2-455d-bf20-237cd3d050d0","Type":"ContainerStarted","Data":"be38a4b3443555ff38fd758d4d255458f2a94da37c3377aec0690a59291d4100"}
Jul 09 17:28:54.887539 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.887512    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978" event={"ID":"ace96505-87af-4160-92b0-8fe2e52caa57","Type":"ContainerStarted","Data":"e26b8bd7ea227a0993deb9eaa1bd9db4f2836a379710d4964ee6ac6ecfbe9b41"}
Jul 09 17:28:54.888875 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.888849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kbmjn" event={"ID":"47f6b04e-8b09-4796-82bb-e4627482008b","Type":"ContainerStarted","Data":"72758951dd78d31759d9d4294e862f0f17d8acdcb7d90cc6b475a112c4446004"}
Jul 09 17:28:54.890185 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.890157    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-gwcbw" event={"ID":"b76ff92a-a229-4bc9-8e47-bd6874831f96","Type":"ContainerStarted","Data":"5815a3bee76997d227b5c5cbb7c6d68490fd058a6f7aeaf66c2a6f9aede7fd65"}
Jul 09 17:28:54.891767 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.891743    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.891767 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.891754    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mm4v5" event={"ID":"4551c739-ce40-4612-98a8-a498cc87b5db","Type":"ContainerStarted","Data":"fe2949dc2ecaffad1d70b9020acd6f7523969952c2a819e575f2365919ba2705"}
Jul 09 17:28:54.903786 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.903735    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7" podStartSLOduration=0.903714197 podStartE2EDuration="903.714197ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:28:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:54.90371603 +0000 UTC m=+58.686435357" watchObservedRunningTime="2026-07-09 17:28:54.903714197 +0000 UTC m=+58.686433508"
Jul 09 17:28:54.909291 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.909267    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:54.976271 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.976245    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-bound-sa-token\") pod \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") "
Jul 09 17:28:54.976414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.976287    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-certificates\") pod \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") "
Jul 09 17:28:54.976414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.976323    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thkdl\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-kube-api-access-thkdl\") pod \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") "
Jul 09 17:28:54.976414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.976356    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-ca-trust-extracted\") pod \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") "
Jul 09 17:28:54.976414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.976380    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-image-registry-private-configuration\") pod \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") "
Jul 09 17:28:54.976414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.976396    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-tls\") pod \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") "
Jul 09 17:28:54.976414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.976415    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-trusted-ca\") pod \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") "
Jul 09 17:28:54.976725 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.976446    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-installation-pull-secrets\") pod \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\" (UID: \"cea9a71e-8f38-416d-9ebe-84ffc4db8b85\") "
Jul 09 17:28:54.980712 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.979134    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cea9a71e-8f38-416d-9ebe-84ffc4db8b85" (UID: "cea9a71e-8f38-416d-9ebe-84ffc4db8b85"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:28:54.980712 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.979475    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cea9a71e-8f38-416d-9ebe-84ffc4db8b85" (UID: "cea9a71e-8f38-416d-9ebe-84ffc4db8b85"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:28:54.980712 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.980359    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cea9a71e-8f38-416d-9ebe-84ffc4db8b85" (UID: "cea9a71e-8f38-416d-9ebe-84ffc4db8b85"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:28:54.982860 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.982382    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cea9a71e-8f38-416d-9ebe-84ffc4db8b85" (UID: "cea9a71e-8f38-416d-9ebe-84ffc4db8b85"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:28:54.982860 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.982498    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cea9a71e-8f38-416d-9ebe-84ffc4db8b85" (UID: "cea9a71e-8f38-416d-9ebe-84ffc4db8b85"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:28:54.985551 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.985522    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cea9a71e-8f38-416d-9ebe-84ffc4db8b85" (UID: "cea9a71e-8f38-416d-9ebe-84ffc4db8b85"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:28:54.985899 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.985871    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cea9a71e-8f38-416d-9ebe-84ffc4db8b85" (UID: "cea9a71e-8f38-416d-9ebe-84ffc4db8b85"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:28:54.995484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:54.995449    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-kube-api-access-thkdl" (OuterVolumeSpecName: "kube-api-access-thkdl") pod "cea9a71e-8f38-416d-9ebe-84ffc4db8b85" (UID: "cea9a71e-8f38-416d-9ebe-84ffc4db8b85"). InnerVolumeSpecName "kube-api-access-thkdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:28:55.078266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.078089    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-image-registry-private-configuration\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:28:55.078266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.078126    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-tls\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:28:55.078266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.078143    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-trusted-ca\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:28:55.078266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.078157    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-installation-pull-secrets\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:28:55.078266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.078172    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-bound-sa-token\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:28:55.078266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.078186    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-registry-certificates\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:28:55.078266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.078217    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thkdl\" (UniqueName: \"kubernetes.io/projected/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-kube-api-access-thkdl\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:28:55.078266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.078232    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cea9a71e-8f38-416d-9ebe-84ffc4db8b85-ca-trust-extracted\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:28:55.900415 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.895772    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69658864c6-m728d"
Jul 09 17:28:55.931330 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.931288    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69658864c6-m728d"]
Jul 09 17:28:55.938586 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:55.938540    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69658864c6-m728d"]
Jul 09 17:28:56.477030 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.476837    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57ddfd477f-bzk82"]
Jul 09 17:28:56.479459 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.479434    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.483636 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.482582    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 17:28:56.483636 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.482793    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 17:28:56.483636 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.482979    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dhccb\""
Jul 09 17:28:56.485111 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.484509    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 17:28:56.485111 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.484520    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 17:28:56.485111 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.484774    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 17:28:56.487851 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.487826    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57ddfd477f-bzk82"]
Jul 09 17:28:56.595490 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.595354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-console-config\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.595490 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.595396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-oauth-config\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.595490 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.595434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-service-ca\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.595722 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.595514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-serving-cert\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.595722 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.595555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-oauth-serving-cert\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.595722 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.595670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crjd2\" (UniqueName: \"kubernetes.io/projected/8772edad-90cd-44dc-8002-c25fce522022-kube-api-access-crjd2\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.673234 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.672174    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cea9a71e-8f38-416d-9ebe-84ffc4db8b85" path="/var/lib/kubelet/pods/cea9a71e-8f38-416d-9ebe-84ffc4db8b85/volumes"
Jul 09 17:28:56.697316 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.696276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crjd2\" (UniqueName: \"kubernetes.io/projected/8772edad-90cd-44dc-8002-c25fce522022-kube-api-access-crjd2\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.697316 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.696337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-console-config\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.697316 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.696367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-oauth-config\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.697316 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.696403    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-service-ca\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.697316 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.696442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-serving-cert\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.697316 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.696470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-oauth-serving-cert\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.697316 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.697250    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-console-config\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.697316 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.697271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-oauth-serving-cert\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.700176 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.700151    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-serving-cert\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.701111 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.701091    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 17:28:56.701274 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.701091    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 17:28:56.706303 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.706012    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crjd2\" (UniqueName: \"kubernetes.io/projected/8772edad-90cd-44dc-8002-c25fce522022-kube-api-access-crjd2\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.707481 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.707426    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-service-ca\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.711904 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.711863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-oauth-config\") pod \"console-57ddfd477f-bzk82\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") " pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:56.797876 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.797808    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dhccb\""
Jul 09 17:28:56.805487 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:56.805246    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:28:57.680424 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:57.680387    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:57.733024 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:57.732936    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:59.465582 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:59.465533    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:59.514815 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:59.514778    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:28:59.827387 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:59.827364    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qcpcg"
Jul 09 17:28:59.975665 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:28:59.975628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:00.024678 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.024648    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:00.395970 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.394986    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:00.461310 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.461213    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57ddfd477f-bzk82"]
Jul 09 17:29:00.464452 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.464412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:00.467148 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:29:00.467116    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8772edad_90cd_44dc_8002_c25fce522022.slice/crio-d82a7939ec9b9472903f491ed7a59836ed30dee40fff4cae090b6d90cb8f2b2e WatchSource:0}: Error finding container d82a7939ec9b9472903f491ed7a59836ed30dee40fff4cae090b6d90cb8f2b2e: Status 404 returned error can't find the container with id d82a7939ec9b9472903f491ed7a59836ed30dee40fff4cae090b6d90cb8f2b2e
Jul 09 17:29:00.910995 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.910956    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mm4v5" event={"ID":"4551c739-ce40-4612-98a8-a498cc87b5db","Type":"ContainerStarted","Data":"c8ebbe553210febfc23394054e974468904a46524224128439906478842971a2"}
Jul 09 17:29:00.912606 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.912571    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tft5v" event={"ID":"91301d75-2ad2-455d-bf20-237cd3d050d0","Type":"ContainerStarted","Data":"e84b507f2e71741cfcdab16e1f50564ba1e596d4b3b911cf25f0be32baa82686"}
Jul 09 17:29:00.914240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.914192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978" event={"ID":"ace96505-87af-4160-92b0-8fe2e52caa57","Type":"ContainerStarted","Data":"20e0d6953c6cbbc06efbd95ddd57100f2e1db3d9a20bd3f7db35b32408e9ee07"}
Jul 09 17:29:00.914416 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.914391    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"
Jul 09 17:29:00.916464 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.916392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kbmjn" event={"ID":"47f6b04e-8b09-4796-82bb-e4627482008b","Type":"ContainerStarted","Data":"092fb955666c1ae94a761a1bda0c48b3cd062936c26dc468f84aeb6bf0fcae4f"}
Jul 09 17:29:00.916464 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.916438    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kbmjn" event={"ID":"47f6b04e-8b09-4796-82bb-e4627482008b","Type":"ContainerStarted","Data":"0810f23c8dbc073bbce5e0be2542cbeb338ff18c06d7231d3ea603b2719bfe8f"}
Jul 09 17:29:00.916464 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.916467    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:29:00.917704 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.917680    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57ddfd477f-bzk82" event={"ID":"8772edad-90cd-44dc-8002-c25fce522022","Type":"ContainerStarted","Data":"d82a7939ec9b9472903f491ed7a59836ed30dee40fff4cae090b6d90cb8f2b2e"}
Jul 09 17:29:00.920304 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.920286    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978"
Jul 09 17:29:00.930086 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.930044    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tft5v" podStartSLOduration=1.179761901 podStartE2EDuration="6.930031805s" totalImagesPullingTime="5.750269904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:00.928415598 +0000 UTC m=+64.711134931" watchObservedRunningTime="2026-07-09 17:29:00.930031805 +0000 UTC m=+64.712751173"
Jul 09 17:29:00.947400 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.947360    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kbmjn" podStartSLOduration=2.049472287 podStartE2EDuration="7.947344523s" totalImagesPullingTime="5.897872236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:00.946946105 +0000 UTC m=+64.729665438" watchObservedRunningTime="2026-07-09 17:29:00.947344523 +0000 UTC m=+64.730063855"
Jul 09 17:29:00.963252 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:00.963188    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7v978" podStartSLOduration=4.9703763 podStartE2EDuration="6.963173117s" totalImagesPullingTime="1.992796817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:00.962279268 +0000 UTC m=+64.744998600" watchObservedRunningTime="2026-07-09 17:29:00.963173117 +0000 UTC m=+64.745892449"
Jul 09 17:29:01.068652 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:01.068532    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:01.147922 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:01.147869    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:01.202365 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:01.202289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:01.671892 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:01.671857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:01.924107 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:01.924018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mm4v5" event={"ID":"4551c739-ce40-4612-98a8-a498cc87b5db","Type":"ContainerStarted","Data":"a2f50cfeebc0d443ca46e70d898cfa1d09acc518d2a76ec0b5331ece2278a63b"}
Jul 09 17:29:02.344795 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.344482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:29:02.347524 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.347499    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 17:29:02.358280 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.358256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75e411b6-ea5d-48ef-b050-3819a0dee45a-metrics-certs\") pod \"network-metrics-daemon-zln6d\" (UID: \"75e411b6-ea5d-48ef-b050-3819a0dee45a\") " pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:29:02.445136 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.445109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:29:02.447978 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.447952    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 17:29:02.460640 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.460615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c6c2219-d209-4d94-a17e-5eb6baa05c02-original-pull-secret\") pod \"global-pull-secret-syncer-2d4dg\" (UID: \"3c6c2219-d209-4d94-a17e-5eb6baa05c02\") " pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:29:02.480761 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.480738    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ls9tf\""
Jul 09 17:29:02.488179 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.488156    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zln6d"
Jul 09 17:29:02.546156 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.546132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:29:02.549295 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.549215    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 17:29:02.559636 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.559614    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 17:29:02.573647 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.573622    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgkps\" (UniqueName: \"kubernetes.io/projected/2a163353-3724-405a-b108-b014900a0464-kube-api-access-cgkps\") pod \"network-check-target-cmvcs\" (UID: \"2a163353-3724-405a-b108-b014900a0464\") " pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:29:02.656507 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.656432    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zln6d"]
Jul 09 17:29:02.661133 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:29:02.661100    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e411b6_ea5d_48ef_b050_3819a0dee45a.slice/crio-32f3e468525e17d3b0ba9d03b436144f0fb8f33a30c818946e9c7ada6f4de078 WatchSource:0}: Error finding container 32f3e468525e17d3b0ba9d03b436144f0fb8f33a30c818946e9c7ada6f4de078: Status 404 returned error can't find the container with id 32f3e468525e17d3b0ba9d03b436144f0fb8f33a30c818946e9c7ada6f4de078
Jul 09 17:29:02.675851 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.673140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2d4dg"
Jul 09 17:29:02.788976 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.788616    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8889q\""
Jul 09 17:29:02.796473 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.796442    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:29:02.881266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.881122    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2d4dg"]
Jul 09 17:29:02.886002 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:29:02.885973    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6c2219_d209_4d94_a17e_5eb6baa05c02.slice/crio-fcedf4f4bb4f4090c0c9a8672722d5f369a27e582694f5c75e0afd8997fb45ae WatchSource:0}: Error finding container fcedf4f4bb4f4090c0c9a8672722d5f369a27e582694f5c75e0afd8997fb45ae: Status 404 returned error can't find the container with id fcedf4f4bb4f4090c0c9a8672722d5f369a27e582694f5c75e0afd8997fb45ae
Jul 09 17:29:02.931348 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.931300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zln6d" event={"ID":"75e411b6-ea5d-48ef-b050-3819a0dee45a","Type":"ContainerStarted","Data":"32f3e468525e17d3b0ba9d03b436144f0fb8f33a30c818946e9c7ada6f4de078"}
Jul 09 17:29:02.933407 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.933381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2d4dg" event={"ID":"3c6c2219-d209-4d94-a17e-5eb6baa05c02","Type":"ContainerStarted","Data":"fcedf4f4bb4f4090c0c9a8672722d5f369a27e582694f5c75e0afd8997fb45ae"}
Jul 09 17:29:02.985354 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:02.985325    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmvcs"]
Jul 09 17:29:02.989444 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:29:02.989402    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a163353_3724_405a_b108_b014900a0464.slice/crio-ef53189e649c4b27f011a51419db081130a4e04c4aa838171293c3fd59f2e7b8 WatchSource:0}: Error finding container ef53189e649c4b27f011a51419db081130a4e04c4aa838171293c3fd59f2e7b8: Status 404 returned error can't find the container with id ef53189e649c4b27f011a51419db081130a4e04c4aa838171293c3fd59f2e7b8
Jul 09 17:29:03.124958 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:03.124926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:03.177795 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:03.177719    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:03.938887 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:03.938846    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmvcs" event={"ID":"2a163353-3724-405a-b108-b014900a0464","Type":"ContainerStarted","Data":"ef53189e649c4b27f011a51419db081130a4e04c4aa838171293c3fd59f2e7b8"}
Jul 09 17:29:06.062121 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.062002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:06.165618 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.164183    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:06.733899 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.733834    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:06.834689 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.834654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:06.953699 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.953628    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57ddfd477f-bzk82" event={"ID":"8772edad-90cd-44dc-8002-c25fce522022","Type":"ContainerStarted","Data":"b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f"}
Jul 09 17:29:06.957533 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.957502    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mm4v5" event={"ID":"4551c739-ce40-4612-98a8-a498cc87b5db","Type":"ContainerStarted","Data":"1bb852935f9b4bb5cd40c0fc0e101f1acf478601d6882b93dd0c908c473b2656"}
Jul 09 17:29:06.960999 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.960974    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zln6d" event={"ID":"75e411b6-ea5d-48ef-b050-3819a0dee45a","Type":"ContainerStarted","Data":"b12ac0378a3ec5ca9dde0eb10499691e55dace3d7c339ec39cceeb70b295e603"}
Jul 09 17:29:06.961121 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.961025    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zln6d" event={"ID":"75e411b6-ea5d-48ef-b050-3819a0dee45a","Type":"ContainerStarted","Data":"194f1ef0e7ff88d6542ddb09355172b438d9dcf71377d36c28f489e65e2667be"}
Jul 09 17:29:06.973332 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.973250    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57ddfd477f-bzk82" podStartSLOduration=5.371680924 podStartE2EDuration="10.973232803s" totalImagesPullingTime="5.601551879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:06.972384062 +0000 UTC m=+70.755103395" watchObservedRunningTime="2026-07-09 17:29:06.973232803 +0000 UTC m=+70.755952138"
Jul 09 17:29:06.995195 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:06.994911    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mm4v5" podStartSLOduration=2.523755353 podStartE2EDuration="13.994893369s" totalImagesPullingTime="11.471138016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:06.993296199 +0000 UTC m=+70.776015536" watchObservedRunningTime="2026-07-09 17:29:06.994893369 +0000 UTC m=+70.777612701"
Jul 09 17:29:07.008516 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:07.008473    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zln6d" podStartSLOduration=67.550540449 podStartE2EDuration="1m11.008455232s" totalImagesPullingTime="3.457914783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:07.007568644 +0000 UTC m=+70.790287978" watchObservedRunningTime="2026-07-09 17:29:07.008455232 +0000 UTC m=+70.791174567"
Jul 09 17:29:07.126784 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:07.126747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:07.180577 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:07.180528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.069848 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.069809    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.127422 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.127392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.209220 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.209159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.310479 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.310443    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.441654 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.441618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.464942 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.464912    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n4pgb"]
Jul 09 17:29:08.468009 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.467985    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.471011 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.470991    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mtzcm\""
Jul 09 17:29:08.472376 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.472279    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 17:29:08.472376 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.472347    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 17:29:08.472376 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.472354    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 17:29:08.472376 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.472364    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 17:29:08.472668 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.472398    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 17:29:08.472668 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.472350    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 17:29:08.514345 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.514306    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.581002 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.580974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.599716 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.599682    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-textfile\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.599836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.599714    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-tls\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.599836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.599763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3aab060-d298-416e-8288-06fbbc402178-metrics-client-ca\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.599959 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.599850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42lwt\" (UniqueName: \"kubernetes.io/projected/d3aab060-d298-416e-8288-06fbbc402178-kube-api-access-42lwt\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.599959 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.599882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3aab060-d298-416e-8288-06fbbc402178-root\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.599959 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.599911    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.599959 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.599938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3aab060-d298-416e-8288-06fbbc402178-sys\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.600124 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.599982    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-wtmp\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.600124 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.600006    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-accelerators-collector-config\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.700576 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.700495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lwt\" (UniqueName: \"kubernetes.io/projected/d3aab060-d298-416e-8288-06fbbc402178-kube-api-access-42lwt\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.700576 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.700530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3aab060-d298-416e-8288-06fbbc402178-root\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.700576 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.700555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.700822 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.700581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3aab060-d298-416e-8288-06fbbc402178-sys\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.700822 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.700619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-wtmp\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.700822 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.700642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-accelerators-collector-config\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.700822 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.700675    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-textfile\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.700822 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.700695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-tls\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.700822 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.700748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3aab060-d298-416e-8288-06fbbc402178-metrics-client-ca\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.701096 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.701070    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3aab060-d298-416e-8288-06fbbc402178-sys\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.701096 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.701082    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3aab060-d298-416e-8288-06fbbc402178-root\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.701435 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.701414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3aab060-d298-416e-8288-06fbbc402178-metrics-client-ca\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.701540 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:29:08.701457    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 17:29:08.701540 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.701458    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-wtmp\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.701540 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:29:08.701514    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-tls podName:d3aab060-d298-416e-8288-06fbbc402178 nodeName:}" failed. No retries permitted until 2026-07-09 17:29:09.201495644 +0000 UTC m=+72.984214953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-tls") pod "node-exporter-n4pgb" (UID: "d3aab060-d298-416e-8288-06fbbc402178") : secret "node-exporter-tls" not found
Jul 09 17:29:08.701698 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.701655    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-accelerators-collector-config\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.701698 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.701681    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-textfile\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.703564 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.703541    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.711787 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.711759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42lwt\" (UniqueName: \"kubernetes.io/projected/d3aab060-d298-416e-8288-06fbbc402178-kube-api-access-42lwt\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:08.717484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.717435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.817910 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.817859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:08.922790 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:08.922756    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:09.018391 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:09.018276    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:09.205810 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:09.205780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-tls\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:09.208417 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:09.208392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3aab060-d298-416e-8288-06fbbc402178-node-exporter-tls\") pod \"node-exporter-n4pgb\" (UID: \"d3aab060-d298-416e-8288-06fbbc402178\") " pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:09.229436 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:09.229401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:09.379234 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:09.379191    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n4pgb"
Jul 09 17:29:09.642148 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:09.642059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:09.742707 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:09.742671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:09.941806 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:29:09.941778    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3aab060_d298_416e_8288_06fbbc402178.slice/crio-6d885b526f2835ffbe2d6d45288760667c9a0805097d0d60eac96e334822415f WatchSource:0}: Error finding container 6d885b526f2835ffbe2d6d45288760667c9a0805097d0d60eac96e334822415f: Status 404 returned error can't find the container with id 6d885b526f2835ffbe2d6d45288760667c9a0805097d0d60eac96e334822415f
Jul 09 17:29:09.976571 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:09.976460    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4pgb" event={"ID":"d3aab060-d298-416e-8288-06fbbc402178","Type":"ContainerStarted","Data":"6d885b526f2835ffbe2d6d45288760667c9a0805097d0d60eac96e334822415f"}
Jul 09 17:29:10.070974 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.070945    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:10.118016 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.117978    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:10.654006 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.653972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:10.754929 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.754894    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:10.857531 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.857492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:10.925803 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.925738    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kbmjn"
Jul 09 17:29:10.983556 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.983520    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmvcs" event={"ID":"2a163353-3724-405a-b108-b014900a0464","Type":"ContainerStarted","Data":"a50cb25c2f15a5c46ba635e0a286498fc4be96846084650a2d079823416eb9ad"}
Jul 09 17:29:10.983716 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.983587    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:29:10.985423 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.985394    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2d4dg" event={"ID":"3c6c2219-d209-4d94-a17e-5eb6baa05c02","Type":"ContainerStarted","Data":"a6afb141f1d59d5a18b185dfeeb2e8fd8c416831577b9df92c6e6c4953f2e304"}
Jul 09 17:29:10.999645 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:10.999605    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cmvcs" podStartSLOduration=68.04134123 podStartE2EDuration="1m14.999586159s" totalImagesPullingTime="6.958244929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:10.998517273 +0000 UTC m=+74.781236605" watchObservedRunningTime="2026-07-09 17:29:10.999586159 +0000 UTC m=+74.782305525"
Jul 09 17:29:11.014406 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.014368    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2d4dg" podStartSLOduration=67.958251257 podStartE2EDuration="1m15.014351554s" totalImagesPullingTime="7.056100297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:11.013590519 +0000 UTC m=+74.796309850" watchObservedRunningTime="2026-07-09 17:29:11.014351554 +0000 UTC m=+74.797070886"
Jul 09 17:29:11.377795 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.377751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:11.428085 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.428042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:11.536052 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.536016    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"]
Jul 09 17:29:11.539693 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.539673    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.542784 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.542756    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 17:29:11.542905 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.542851    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c7qc4\""
Jul 09 17:29:11.542905 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.542761    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 17:29:11.543004 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.542761    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-35dne41ngp58l\""
Jul 09 17:29:11.543403 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.543284    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 17:29:11.543403 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.543306    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 17:29:11.543403 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.543289    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 17:29:11.551498 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.551477    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"]
Jul 09 17:29:11.571796 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.571756    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:11.627328 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.627298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.627480 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.627342    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-grpc-tls\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.627480 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.627364    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctqlh\" (UniqueName: \"kubernetes.io/projected/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-kube-api-access-ctqlh\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.627480 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.627397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.627480 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.627420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-tls\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.627480 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.627446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.627701 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.627482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-metrics-client-ca\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.627701 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.627543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.691797 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.691704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:11.728747 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.728718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.728894 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.728768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-grpc-tls\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.728894 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.728801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctqlh\" (UniqueName: \"kubernetes.io/projected/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-kube-api-access-ctqlh\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.728894 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.728829    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.728894 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.728864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-tls\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.729088 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.728896    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.729088 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.728928    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-metrics-client-ca\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.729297 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.729264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.729714 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.729690    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-metrics-client-ca\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.731859 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.731832    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.731859 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.731849    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.732144 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.732121    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.732297 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.732277    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.732656 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.732635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-grpc-tls\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.732796 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.732778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-secret-thanos-querier-tls\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.737864 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.737841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctqlh\" (UniqueName: \"kubernetes.io/projected/3f70cf43-9ebd-46cf-9ee3-6694dcbda453-kube-api-access-ctqlh\") pod \"thanos-querier-645b54c9f5-tnc9j\" (UID: \"3f70cf43-9ebd-46cf-9ee3-6694dcbda453\") " pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:11.850553 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:11.850518    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:12.761813 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.759851    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-655cb869dd-l8tcr"]
Jul 09 17:29:12.763989 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.763938    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:12.767074 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.767011    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 17:29:12.769138 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.769116    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 17:29:12.769276 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.769119    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1r35f852eep0r\""
Jul 09 17:29:12.769446 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.769426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 17:29:12.769708 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.769674    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mzpj2\""
Jul 09 17:29:12.769867 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.769843    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 17:29:12.770646 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.770624    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-655cb869dd-l8tcr"]
Jul 09 17:29:12.937386 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.937351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-secret-metrics-server-client-certs\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:12.937554 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.937400    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-audit-log\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:12.937554 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.937436    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-secret-metrics-server-tls\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:12.937554 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.937459    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-client-ca-bundle\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:12.937554 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.937491    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-metrics-server-audit-profiles\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:12.937755 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.937560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:12.937755 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:12.937623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszxb\" (UniqueName: \"kubernetes.io/projected/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-kube-api-access-tszxb\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.038542 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.038465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.038542 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.038519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tszxb\" (UniqueName: \"kubernetes.io/projected/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-kube-api-access-tszxb\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.038732 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.038556    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-secret-metrics-server-client-certs\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.038732 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.038580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-audit-log\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.038732 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.038612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-secret-metrics-server-tls\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.038732 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.038642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-client-ca-bundle\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.038732 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.038671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-metrics-server-audit-profiles\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.039359 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.039068    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-audit-log\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.039359 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.039293    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.039686 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.039632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-metrics-server-audit-profiles\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.041502 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.041481    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-secret-metrics-server-client-certs\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.041749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.041725    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-client-ca-bundle\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.041801 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.041763    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-secret-metrics-server-tls\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.048742 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.048721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszxb\" (UniqueName: \"kubernetes.io/projected/5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f-kube-api-access-tszxb\") pod \"metrics-server-655cb869dd-l8tcr\" (UID: \"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f\") " pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.076617 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.076594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:13.258048 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.258010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:13.343150 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.343123    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57ddfd477f-bzk82"]
Jul 09 17:29:13.354749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.354720    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:13.368367 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.368341    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76dd6dc99d-qht6n"]
Jul 09 17:29:13.371634 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.371617    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.380732 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.380712    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 17:29:13.382360 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.382336    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76dd6dc99d-qht6n"]
Jul 09 17:29:13.542503 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.542471    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-oauth-serving-cert\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.542503 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.542515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-oauth-config\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.542751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.542554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-trusted-ca-bundle\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.542751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.542616    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-config\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.542751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.542703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-service-ca\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.542910 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.542771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-serving-cert\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.542910 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.542802    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzgd8\" (UniqueName: \"kubernetes.io/projected/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-kube-api-access-xzgd8\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.542910 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.542806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:13.643667 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.643592    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-service-ca\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.643667 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.643634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-serving-cert\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.643667 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.643662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzgd8\" (UniqueName: \"kubernetes.io/projected/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-kube-api-access-xzgd8\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.643935 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.643693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-oauth-serving-cert\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.643935 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.643725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-oauth-config\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.643935 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.643765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-trusted-ca-bundle\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.643935 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.643795    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-config\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.644450 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.644418    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-service-ca\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.644671 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.644642    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-config\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.644792 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.644728    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-trusted-ca-bundle\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.644792 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.644720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-oauth-serving-cert\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.647124 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.647100    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-serving-cert\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.647262 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.647146    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-oauth-config\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.655741 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.655722    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzgd8\" (UniqueName: \"kubernetes.io/projected/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-kube-api-access-xzgd8\") pod \"console-76dd6dc99d-qht6n\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") " pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.683889 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.683840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:13.967865 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:13.967774    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:14.027603 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:14.027541    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:14.637825 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:14.637787    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:14.725106 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:14.725070    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:15.900738 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:15.900709    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d7cb5cb77-b5vb7"
Jul 09 17:29:16.020524 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:16.020487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:16.118785 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:16.118742    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:16.231638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:16.231555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:16.311528 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:16.311487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:16.806014 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:16.805977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:29:18.217028 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:18.215886    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"]
Jul 09 17:29:18.234736 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:18.234713    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76dd6dc99d-qht6n"]
Jul 09 17:29:18.236076 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:29:18.236043    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2c1556_00a9_43ae_b97a_e4f35a0b03e1.slice/crio-2a5dfb2d51277ada9182bcfe71b68278260449fa74a7eef731942af814d70e6d WatchSource:0}: Error finding container 2a5dfb2d51277ada9182bcfe71b68278260449fa74a7eef731942af814d70e6d: Status 404 returned error can't find the container with id 2a5dfb2d51277ada9182bcfe71b68278260449fa74a7eef731942af814d70e6d
Jul 09 17:29:18.250111 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:18.250086    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-655cb869dd-l8tcr"]
Jul 09 17:29:18.322783 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:29:18.322751    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e6ee9bc_94ec_4933_9e92_fa4f0c9ecf1f.slice/crio-4ed6db3e357c068a268c68c20c21e1379a88bff12e3645d01547ad073b67577f WatchSource:0}: Error finding container 4ed6db3e357c068a268c68c20c21e1379a88bff12e3645d01547ad073b67577f: Status 404 returned error can't find the container with id 4ed6db3e357c068a268c68c20c21e1379a88bff12e3645d01547ad073b67577f
Jul 09 17:29:18.410518 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:18.410483    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:18.511626 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:18.511578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:19.021804 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.020841    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr" event={"ID":"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f","Type":"ContainerStarted","Data":"4ed6db3e357c068a268c68c20c21e1379a88bff12e3645d01547ad073b67577f"}
Jul 09 17:29:19.023294 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.023224    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-gwcbw" event={"ID":"b76ff92a-a229-4bc9-8e47-bd6874831f96","Type":"ContainerStarted","Data":"07f7816b14f36c2ca8098898d7e35e290f4f3cc32fcf93f8fd73a46ab8447986"}
Jul 09 17:29:19.024211 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.024170    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-gwcbw"
Jul 09 17:29:19.027063 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.027015    2583 generic.go:356] "Generic (PLEG): container finished" podID="d3aab060-d298-416e-8288-06fbbc402178" containerID="1320ddd14fb13ad18f6d3bb24a32d2c590b5d8a9b4dc9cba5966353ef9bcac01" exitCode=0
Jul 09 17:29:19.027185 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.027096    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4pgb" event={"ID":"d3aab060-d298-416e-8288-06fbbc402178","Type":"ContainerDied","Data":"1320ddd14fb13ad18f6d3bb24a32d2c590b5d8a9b4dc9cba5966353ef9bcac01"}
Jul 09 17:29:19.029441 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.029414    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j" event={"ID":"3f70cf43-9ebd-46cf-9ee3-6694dcbda453","Type":"ContainerStarted","Data":"3f422e15b9b10323e251300903b870c3e6dd10c880ff3799d6aefb6ba7163159"}
Jul 09 17:29:19.032031 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.031794    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76dd6dc99d-qht6n" event={"ID":"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1","Type":"ContainerStarted","Data":"d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8"}
Jul 09 17:29:19.032031 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.031835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76dd6dc99d-qht6n" event={"ID":"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1","Type":"ContainerStarted","Data":"2a5dfb2d51277ada9182bcfe71b68278260449fa74a7eef731942af814d70e6d"}
Jul 09 17:29:19.036995 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.036973    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-gwcbw"
Jul 09 17:29:19.044580 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.044535    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-gwcbw" podStartSLOduration=1.557754495 podStartE2EDuration="25.044522619s" totalImagesPullingTime="23.486768124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:19.044042117 +0000 UTC m=+82.826761462" watchObservedRunningTime="2026-07-09 17:29:19.044522619 +0000 UTC m=+82.827241949"
Jul 09 17:29:19.873742 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:19.873669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:20.040642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:20.040494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4pgb" event={"ID":"d3aab060-d298-416e-8288-06fbbc402178","Type":"ContainerStarted","Data":"96973e831ac1f21acf4cb4d646cb4cd9e18e9af06cea84eaa2b140cb935c934c"}
Jul 09 17:29:20.040642 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:20.040597    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4pgb" event={"ID":"d3aab060-d298-416e-8288-06fbbc402178","Type":"ContainerStarted","Data":"9dad686955d1e5b0cc00efd6eb65f35b0f36563530a59e94aead96dd729d8251"}
Jul 09 17:29:20.051388 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:20.051344    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:20.063719 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:20.063642    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76dd6dc99d-qht6n" podStartSLOduration=7.063621744 podStartE2EDuration="7.063621744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:19.104917417 +0000 UTC m=+82.887636749" watchObservedRunningTime="2026-07-09 17:29:20.063621744 +0000 UTC m=+83.846341076"
Jul 09 17:29:20.064093 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:20.064049    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n4pgb" podStartSLOduration=3.865722259 podStartE2EDuration="12.064038299s" totalImagesPullingTime="8.113306247s" totalInitContainerRuntime="85.009793ms" isStatefulPod=true podCreationTimestamp="2026-07-09 17:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:20.061332855 +0000 UTC m=+83.844052191" watchObservedRunningTime="2026-07-09 17:29:20.064038299 +0000 UTC m=+83.846757632"
Jul 09 17:29:20.153001 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:20.152846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:21.364629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:21.364597    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:21.467462 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:21.467428    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:21.572117 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:21.572084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:22.052604 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.052570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr" event={"ID":"5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f","Type":"ContainerStarted","Data":"241ac887f62c42808c2a07cda76d802c265a71acf545f96dd4e13c779d315a0f"}
Jul 09 17:29:22.055649 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.055622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j" event={"ID":"3f70cf43-9ebd-46cf-9ee3-6694dcbda453","Type":"ContainerStarted","Data":"e036b1f50fc81e10190819c76669c2c90eda47b25e7f47197413594cdaa80267"}
Jul 09 17:29:22.055759 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.055691    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j" event={"ID":"3f70cf43-9ebd-46cf-9ee3-6694dcbda453","Type":"ContainerStarted","Data":"943cd7f5286fa2e8bcb80a4c6332a9cd5fb8425cad29d930f597d48036547e1e"}
Jul 09 17:29:22.055759 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.055733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j" event={"ID":"3f70cf43-9ebd-46cf-9ee3-6694dcbda453","Type":"ContainerStarted","Data":"d3c57c6267c79ae6a1dea50367f199f915826d9a455348fc15619362ceda0cec"}
Jul 09 17:29:22.076057 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.076009    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr" podStartSLOduration=6.768317681 podStartE2EDuration="10.075991589s" totalImagesPullingTime="3.307673908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:22.075306124 +0000 UTC m=+85.858025455" watchObservedRunningTime="2026-07-09 17:29:22.075991589 +0000 UTC m=+85.858710903"
Jul 09 17:29:22.216349 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.216256    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76dd6dc99d-qht6n"]
Jul 09 17:29:22.254597 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.253335    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b8f9ccc9b-zd9qj"]
Jul 09 17:29:22.269462 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.269435    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8f9ccc9b-zd9qj"]
Jul 09 17:29:22.269627 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.269562    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.286836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.286803    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:22.320679 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.320651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-trusted-ca-bundle\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.320811 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.320699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-serving-cert\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.320811 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.320772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-service-ca\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.320912 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.320840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-config\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.320912 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.320893    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-oauth-serving-cert\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.320999 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.320921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wckhb\" (UniqueName: \"kubernetes.io/projected/1421f6cf-4a56-48ab-92ee-68b535eacecb-kube-api-access-wckhb\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.320999 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.320963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-oauth-config\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.343165 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.343140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:22.421360 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.421336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-oauth-serving-cert\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.421751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.421370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wckhb\" (UniqueName: \"kubernetes.io/projected/1421f6cf-4a56-48ab-92ee-68b535eacecb-kube-api-access-wckhb\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.421751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.421396    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-oauth-config\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.421751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.421429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-trusted-ca-bundle\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.421751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.421460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-serving-cert\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.421751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.421509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-service-ca\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.421751 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.421546    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-config\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.422715 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.422692    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-oauth-serving-cert\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.422876 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.422815    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-config\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.423402 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.423264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-service-ca\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.424003 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.423980    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-trusted-ca-bundle\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.424353 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.424329    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-oauth-config\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.424821 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.424792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-serving-cert\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.431132 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.431089    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wckhb\" (UniqueName: \"kubernetes.io/projected/1421f6cf-4a56-48ab-92ee-68b535eacecb-kube-api-access-wckhb\") pod \"console-7b8f9ccc9b-zd9qj\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") " pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.581079 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.581047    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:22.756606 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:22.756579    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8f9ccc9b-zd9qj"]
Jul 09 17:29:22.897992 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:29:22.897910    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1421f6cf_4a56_48ab_92ee_68b535eacecb.slice/crio-71ed4f3ec8f6923b610f7a9351947be698b43a4a7d4e7678ef9585c2c1946811 WatchSource:0}: Error finding container 71ed4f3ec8f6923b610f7a9351947be698b43a4a7d4e7678ef9585c2c1946811: Status 404 returned error can't find the container with id 71ed4f3ec8f6923b610f7a9351947be698b43a4a7d4e7678ef9585c2c1946811
Jul 09 17:29:23.036100 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:23.036069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:23.064517 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:23.064483    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8f9ccc9b-zd9qj" event={"ID":"1421f6cf-4a56-48ab-92ee-68b535eacecb","Type":"ContainerStarted","Data":"602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4"}
Jul 09 17:29:23.064666 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:23.064545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8f9ccc9b-zd9qj" event={"ID":"1421f6cf-4a56-48ab-92ee-68b535eacecb","Type":"ContainerStarted","Data":"71ed4f3ec8f6923b610f7a9351947be698b43a4a7d4e7678ef9585c2c1946811"}
Jul 09 17:29:23.085551 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:23.085504    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b8f9ccc9b-zd9qj" podStartSLOduration=1.085485921 podStartE2EDuration="1.085485921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:23.082651151 +0000 UTC m=+86.865370483" watchObservedRunningTime="2026-07-09 17:29:23.085485921 +0000 UTC m=+86.868205252"
Jul 09 17:29:23.139827 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:23.139792    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:23.684707 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:23.684677    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:24.072659 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:24.072618    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j" event={"ID":"3f70cf43-9ebd-46cf-9ee3-6694dcbda453","Type":"ContainerStarted","Data":"3e77c5f4f3df58d95dfacbfa35e357a79cdaa25621d22c7821d284fc6fd45ec6"}
Jul 09 17:29:24.072849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:24.072710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j" event={"ID":"3f70cf43-9ebd-46cf-9ee3-6694dcbda453","Type":"ContainerStarted","Data":"c320174359f65e3c4226a2e0a1c706a5b52c1cbdf06218c7f11578899c1cfe7f"}
Jul 09 17:29:24.072849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:24.072747    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j" event={"ID":"3f70cf43-9ebd-46cf-9ee3-6694dcbda453","Type":"ContainerStarted","Data":"e2a3259792b8f5c816d2b547a21856fea2280c7daa02c11bd643fd82893968c7"}
Jul 09 17:29:24.096078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:24.096027    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j" podStartSLOduration=8.455696855 podStartE2EDuration="13.096012472s" totalImagesPullingTime="4.640315617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:24.094012305 +0000 UTC m=+87.876731639" watchObservedRunningTime="2026-07-09 17:29:24.096012472 +0000 UTC m=+87.878731811"
Jul 09 17:29:25.083112 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:25.083080    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:26.094341 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:26.094310    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-645b54c9f5-tnc9j"
Jul 09 17:29:29.049335 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:29.049299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:29.150182 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:29.150152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:32.581553 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:32.581522    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:32.582017 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:32.581580    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:32.587351 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:32.586943    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:33.076868 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:33.076787    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:33.076868 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:33.076846    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:33.118547 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:33.118518    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:29:33.281508 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:33.281481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:33.335010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:33.334983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:33.388062 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:33.388033    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:33.442509 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:33.442486    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:29:38.365910 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.365868    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57ddfd477f-bzk82" podUID="8772edad-90cd-44dc-8002-c25fce522022" containerName="console" containerID="cri-o://b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f" gracePeriod=15
Jul 09 17:29:38.638858 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.638803    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:29:38.741783 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.741762    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-service-ca\") pod \"8772edad-90cd-44dc-8002-c25fce522022\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") "
Jul 09 17:29:38.741898 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.741810    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-oauth-serving-cert\") pod \"8772edad-90cd-44dc-8002-c25fce522022\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") "
Jul 09 17:29:38.741898 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.741832    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-console-config\") pod \"8772edad-90cd-44dc-8002-c25fce522022\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") "
Jul 09 17:29:38.741898 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.741863    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-serving-cert\") pod \"8772edad-90cd-44dc-8002-c25fce522022\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") "
Jul 09 17:29:38.741898 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.741892    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crjd2\" (UniqueName: \"kubernetes.io/projected/8772edad-90cd-44dc-8002-c25fce522022-kube-api-access-crjd2\") pod \"8772edad-90cd-44dc-8002-c25fce522022\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") "
Jul 09 17:29:38.742052 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.741909    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-oauth-config\") pod \"8772edad-90cd-44dc-8002-c25fce522022\" (UID: \"8772edad-90cd-44dc-8002-c25fce522022\") "
Jul 09 17:29:38.744733 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.742441    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-service-ca" (OuterVolumeSpecName: "service-ca") pod "8772edad-90cd-44dc-8002-c25fce522022" (UID: "8772edad-90cd-44dc-8002-c25fce522022"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:29:38.744733 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.742547    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-console-config" (OuterVolumeSpecName: "console-config") pod "8772edad-90cd-44dc-8002-c25fce522022" (UID: "8772edad-90cd-44dc-8002-c25fce522022"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:29:38.744733 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.742782    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8772edad-90cd-44dc-8002-c25fce522022" (UID: "8772edad-90cd-44dc-8002-c25fce522022"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:29:38.745591 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.745556    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8772edad-90cd-44dc-8002-c25fce522022" (UID: "8772edad-90cd-44dc-8002-c25fce522022"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:29:38.747998 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.747962    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8772edad-90cd-44dc-8002-c25fce522022-kube-api-access-crjd2" (OuterVolumeSpecName: "kube-api-access-crjd2") pod "8772edad-90cd-44dc-8002-c25fce522022" (UID: "8772edad-90cd-44dc-8002-c25fce522022"). InnerVolumeSpecName "kube-api-access-crjd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:29:38.748142 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.748123    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8772edad-90cd-44dc-8002-c25fce522022" (UID: "8772edad-90cd-44dc-8002-c25fce522022"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:29:38.842536 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.842513    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-oauth-serving-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:38.842629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.842555    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-console-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:38.842629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.842566    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-serving-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:38.842629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.842575    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crjd2\" (UniqueName: \"kubernetes.io/projected/8772edad-90cd-44dc-8002-c25fce522022-kube-api-access-crjd2\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:38.842629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.842584    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8772edad-90cd-44dc-8002-c25fce522022-console-oauth-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:38.842629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:38.842592    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8772edad-90cd-44dc-8002-c25fce522022-service-ca\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:39.137683 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:39.137654    2583 generic.go:356] "Generic (PLEG): container finished" podID="8772edad-90cd-44dc-8002-c25fce522022" containerID="b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f" exitCode=0
Jul 09 17:29:39.137808 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:39.137707    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57ddfd477f-bzk82" event={"ID":"8772edad-90cd-44dc-8002-c25fce522022","Type":"ContainerDied","Data":"b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f"}
Jul 09 17:29:39.137808 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:39.137722    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57ddfd477f-bzk82"
Jul 09 17:29:39.137808 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:39.137767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57ddfd477f-bzk82" event={"ID":"8772edad-90cd-44dc-8002-c25fce522022","Type":"ContainerDied","Data":"d82a7939ec9b9472903f491ed7a59836ed30dee40fff4cae090b6d90cb8f2b2e"}
Jul 09 17:29:39.137808 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:39.137787    2583 scope.go:117] "RemoveContainer" containerID="b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f"
Jul 09 17:29:39.145773 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:39.145752    2583 scope.go:117] "RemoveContainer" containerID="b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f"
Jul 09 17:29:39.146087 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:29:39.146066    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f\": container with ID starting with b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f not found: ID does not exist" containerID="b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f"
Jul 09 17:29:39.146147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:39.146094    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f"} err="failed to get container status \"b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f\": rpc error: code = NotFound desc = could not find container \"b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f\": container with ID starting with b5943e7218489638afb7426c94ad4edba3d799593bf90873008b9ae23521c60f not found: ID does not exist"
Jul 09 17:29:39.160312 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:39.160286    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57ddfd477f-bzk82"]
Jul 09 17:29:39.163824 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:39.163804    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57ddfd477f-bzk82"]
Jul 09 17:29:40.668982 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:40.668944    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8772edad-90cd-44dc-8002-c25fce522022" path="/var/lib/kubelet/pods/8772edad-90cd-44dc-8002-c25fce522022/volumes"
Jul 09 17:29:41.994433 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:41.994403    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cmvcs"
Jul 09 17:29:47.242703 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.242636    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76dd6dc99d-qht6n" podUID="7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" containerName="console" containerID="cri-o://d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8" gracePeriod=15
Jul 09 17:29:47.513952 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.513906    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:47.595717 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.595693    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-oauth-serving-cert\") pod \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") "
Jul 09 17:29:47.595844 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.595733    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-serving-cert\") pod \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") "
Jul 09 17:29:47.595844 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.595766    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-config\") pod \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") "
Jul 09 17:29:47.595844 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.595784    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-oauth-config\") pod \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") "
Jul 09 17:29:47.595844 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.595813    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-trusted-ca-bundle\") pod \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") "
Jul 09 17:29:47.595844 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.595839    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzgd8\" (UniqueName: \"kubernetes.io/projected/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-kube-api-access-xzgd8\") pod \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") "
Jul 09 17:29:47.596307 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.595879    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-service-ca\") pod \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\" (UID: \"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1\") "
Jul 09 17:29:47.596307 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.596144    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" (UID: "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:29:47.596307 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.596295    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-config" (OuterVolumeSpecName: "console-config") pod "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" (UID: "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:29:47.596440 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.596347    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" (UID: "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:29:47.596440 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.596389    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-service-ca" (OuterVolumeSpecName: "service-ca") pod "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" (UID: "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:29:47.597925 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.597895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" (UID: "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:29:47.598017 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.597933    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" (UID: "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:29:47.598017 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.597947    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-kube-api-access-xzgd8" (OuterVolumeSpecName: "kube-api-access-xzgd8") pod "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" (UID: "7f2c1556-00a9-43ae-b97a-e4f35a0b03e1"). InnerVolumeSpecName "kube-api-access-xzgd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:29:47.697208 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.697172    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-oauth-serving-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:47.697296 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.697220    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-serving-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:47.697296 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.697236    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:47.697296 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.697251    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-console-oauth-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:47.697296 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.697263    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-trusted-ca-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:47.697296 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.697276    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzgd8\" (UniqueName: \"kubernetes.io/projected/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-kube-api-access-xzgd8\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:47.697296 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:47.697289    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1-service-ca\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:29:48.171292 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.171260    2583 generic.go:356] "Generic (PLEG): container finished" podID="7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" containerID="d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8" exitCode=0
Jul 09 17:29:48.171446 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.171305    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76dd6dc99d-qht6n"
Jul 09 17:29:48.171446 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.171332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76dd6dc99d-qht6n" event={"ID":"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1","Type":"ContainerDied","Data":"d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8"}
Jul 09 17:29:48.171446 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.171372    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76dd6dc99d-qht6n" event={"ID":"7f2c1556-00a9-43ae-b97a-e4f35a0b03e1","Type":"ContainerDied","Data":"2a5dfb2d51277ada9182bcfe71b68278260449fa74a7eef731942af814d70e6d"}
Jul 09 17:29:48.171446 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.171392    2583 scope.go:117] "RemoveContainer" containerID="d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8"
Jul 09 17:29:48.195570 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.193055    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76dd6dc99d-qht6n"]
Jul 09 17:29:48.200910 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.200889    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76dd6dc99d-qht6n"]
Jul 09 17:29:48.203092 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.203073    2583 scope.go:117] "RemoveContainer" containerID="d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8"
Jul 09 17:29:48.203389 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:29:48.203369    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8\": container with ID starting with d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8 not found: ID does not exist" containerID="d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8"
Jul 09 17:29:48.203458 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.203401    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8"} err="failed to get container status \"d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8\": rpc error: code = NotFound desc = could not find container \"d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8\": container with ID starting with d1dac029246ca783cdc4fa695011806218bf9be1b271347afadf6e33aba7c1a8 not found: ID does not exist"
Jul 09 17:29:48.668974 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:48.668944    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" path="/var/lib/kubelet/pods/7f2c1556-00a9-43ae-b97a-e4f35a0b03e1/volumes"
Jul 09 17:29:53.082039 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:53.082010    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:29:53.085925 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:29:53.085871    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-655cb869dd-l8tcr"
Jul 09 17:30:03.046800 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:03.046759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:24.542275 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:24.542224    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:24.642302 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:24.642270    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:31.567535 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.567500    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84ddc7b99d-4p6jh"]
Jul 09 17:30:31.567914 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.567781    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8772edad-90cd-44dc-8002-c25fce522022" containerName="console"
Jul 09 17:30:31.567914 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.567796    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8772edad-90cd-44dc-8002-c25fce522022" containerName="console"
Jul 09 17:30:31.567914 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.567826    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" containerName="console"
Jul 09 17:30:31.567914 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.567836    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" containerName="console"
Jul 09 17:30:31.567914 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.567884    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8772edad-90cd-44dc-8002-c25fce522022" containerName="console"
Jul 09 17:30:31.567914 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.567894    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f2c1556-00a9-43ae-b97a-e4f35a0b03e1" containerName="console"
Jul 09 17:30:31.572031 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.572014    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.584587 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.584557    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ddc7b99d-4p6jh"]
Jul 09 17:30:31.702027 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.702006    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-service-ca\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.702126 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.702034    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n6vt\" (UniqueName: \"kubernetes.io/projected/9f406f34-5146-4fa3-9efa-a3611af74c4f-kube-api-access-9n6vt\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.702126 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.702062    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-oauth-serving-cert\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.702195 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.702139    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-serving-cert\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.702195 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.702163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-trusted-ca-bundle\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.702195 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.702186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-oauth-config\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.702323 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.702217    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-config\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.715762 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.715734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:31.803057 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n6vt\" (UniqueName: \"kubernetes.io/projected/9f406f34-5146-4fa3-9efa-a3611af74c4f-kube-api-access-9n6vt\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.803148 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-oauth-serving-cert\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.803148 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-serving-cert\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.803148 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803106    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-trusted-ca-bundle\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.803148 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-oauth-config\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.803148 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-config\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.803419 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-service-ca\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.803836 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803812    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-oauth-serving-cert\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.803945 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-service-ca\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.804037 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.803918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-config\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.804037 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.804013    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-trusted-ca-bundle\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.805561 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.805543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-serving-cert\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.805888 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.805871    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-oauth-config\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.810797 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.810778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n6vt\" (UniqueName: \"kubernetes.io/projected/9f406f34-5146-4fa3-9efa-a3611af74c4f-kube-api-access-9n6vt\") pod \"console-84ddc7b99d-4p6jh\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") " pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:31.816027 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.816006    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:31.881599 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:31.881579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:32.003761 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:32.003734    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84ddc7b99d-4p6jh"]
Jul 09 17:30:32.325903 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:32.325828    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ddc7b99d-4p6jh" event={"ID":"9f406f34-5146-4fa3-9efa-a3611af74c4f","Type":"ContainerStarted","Data":"bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0"}
Jul 09 17:30:32.325903 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:32.325876    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ddc7b99d-4p6jh" event={"ID":"9f406f34-5146-4fa3-9efa-a3611af74c4f","Type":"ContainerStarted","Data":"12e416ac74c7d75e6b1b2cf8ad715da332c22bb2046380b2915ac57ec3358250"}
Jul 09 17:30:32.344333 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:32.344292    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84ddc7b99d-4p6jh" podStartSLOduration=1.344277215 podStartE2EDuration="1.344277215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:32.341911888 +0000 UTC m=+156.124631221" watchObservedRunningTime="2026-07-09 17:30:32.344277215 +0000 UTC m=+156.126996661"
Jul 09 17:30:36.374136 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:36.374100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:36.427906 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:36.427856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:41.882749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:41.882714    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:41.883115 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:41.882780    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:41.887139 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:41.887118    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:42.365404 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:42.365378    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:30:42.410362 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:42.410335    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8f9ccc9b-zd9qj"]
Jul 09 17:30:42.513944 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:42.513911    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:42.615464 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:42.615394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:42.715952 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:42.715919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:48.417258 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:48.417189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:48.515769 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:48.515731    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:30:48.616417 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:30:48.616385    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:06.055016 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:06.054978    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:06.113401 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:06.113370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:07.435933 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.435876    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b8f9ccc9b-zd9qj" podUID="1421f6cf-4a56-48ab-92ee-68b535eacecb" containerName="console" containerID="cri-o://602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4" gracePeriod=15
Jul 09 17:31:07.675604 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.675583    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:31:07.749318 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749237    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wckhb\" (UniqueName: \"kubernetes.io/projected/1421f6cf-4a56-48ab-92ee-68b535eacecb-kube-api-access-wckhb\") pod \"1421f6cf-4a56-48ab-92ee-68b535eacecb\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") "
Jul 09 17:31:07.749318 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749295    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-oauth-serving-cert\") pod \"1421f6cf-4a56-48ab-92ee-68b535eacecb\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") "
Jul 09 17:31:07.749511 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749327    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-config\") pod \"1421f6cf-4a56-48ab-92ee-68b535eacecb\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") "
Jul 09 17:31:07.749511 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749367    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-trusted-ca-bundle\") pod \"1421f6cf-4a56-48ab-92ee-68b535eacecb\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") "
Jul 09 17:31:07.749511 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749398    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-serving-cert\") pod \"1421f6cf-4a56-48ab-92ee-68b535eacecb\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") "
Jul 09 17:31:07.749511 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749441    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-oauth-config\") pod \"1421f6cf-4a56-48ab-92ee-68b535eacecb\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") "
Jul 09 17:31:07.749511 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749477    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-service-ca\") pod \"1421f6cf-4a56-48ab-92ee-68b535eacecb\" (UID: \"1421f6cf-4a56-48ab-92ee-68b535eacecb\") "
Jul 09 17:31:07.749785 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749754    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1421f6cf-4a56-48ab-92ee-68b535eacecb" (UID: "1421f6cf-4a56-48ab-92ee-68b535eacecb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:31:07.749848 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749770    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-config" (OuterVolumeSpecName: "console-config") pod "1421f6cf-4a56-48ab-92ee-68b535eacecb" (UID: "1421f6cf-4a56-48ab-92ee-68b535eacecb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:31:07.749848 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749787    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1421f6cf-4a56-48ab-92ee-68b535eacecb" (UID: "1421f6cf-4a56-48ab-92ee-68b535eacecb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:31:07.749993 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.749974    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-service-ca" (OuterVolumeSpecName: "service-ca") pod "1421f6cf-4a56-48ab-92ee-68b535eacecb" (UID: "1421f6cf-4a56-48ab-92ee-68b535eacecb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:31:07.751370 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.751349    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1421f6cf-4a56-48ab-92ee-68b535eacecb-kube-api-access-wckhb" (OuterVolumeSpecName: "kube-api-access-wckhb") pod "1421f6cf-4a56-48ab-92ee-68b535eacecb" (UID: "1421f6cf-4a56-48ab-92ee-68b535eacecb"). InnerVolumeSpecName "kube-api-access-wckhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:31:07.751512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.751490    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1421f6cf-4a56-48ab-92ee-68b535eacecb" (UID: "1421f6cf-4a56-48ab-92ee-68b535eacecb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:31:07.751571 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.751550    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1421f6cf-4a56-48ab-92ee-68b535eacecb" (UID: "1421f6cf-4a56-48ab-92ee-68b535eacecb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:31:07.850394 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.850366    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-service-ca\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:07.850394 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.850391    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wckhb\" (UniqueName: \"kubernetes.io/projected/1421f6cf-4a56-48ab-92ee-68b535eacecb-kube-api-access-wckhb\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:07.850559 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.850401    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-oauth-serving-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:07.850559 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.850411    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:07.850559 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.850419    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1421f6cf-4a56-48ab-92ee-68b535eacecb-trusted-ca-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:07.850559 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.850428    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-serving-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:07.850559 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:07.850436    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1421f6cf-4a56-48ab-92ee-68b535eacecb-console-oauth-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:08.450680 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.450644    2583 generic.go:356] "Generic (PLEG): container finished" podID="1421f6cf-4a56-48ab-92ee-68b535eacecb" containerID="602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4" exitCode=0
Jul 09 17:31:08.451114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.450695    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8f9ccc9b-zd9qj"
Jul 09 17:31:08.451114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.450698    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8f9ccc9b-zd9qj" event={"ID":"1421f6cf-4a56-48ab-92ee-68b535eacecb","Type":"ContainerDied","Data":"602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4"}
Jul 09 17:31:08.451114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.450847    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8f9ccc9b-zd9qj" event={"ID":"1421f6cf-4a56-48ab-92ee-68b535eacecb","Type":"ContainerDied","Data":"71ed4f3ec8f6923b610f7a9351947be698b43a4a7d4e7678ef9585c2c1946811"}
Jul 09 17:31:08.451114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.450871    2583 scope.go:117] "RemoveContainer" containerID="602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4"
Jul 09 17:31:08.459532 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.459516    2583 scope.go:117] "RemoveContainer" containerID="602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4"
Jul 09 17:31:08.459779 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:31:08.459763    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4\": container with ID starting with 602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4 not found: ID does not exist" containerID="602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4"
Jul 09 17:31:08.459829 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.459786    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4"} err="failed to get container status \"602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4\": rpc error: code = NotFound desc = could not find container \"602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4\": container with ID starting with 602818a2419aa33039cce27ee130798cbe6aca9e743596929153efdab8bd27d4 not found: ID does not exist"
Jul 09 17:31:08.473342 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.473304    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8f9ccc9b-zd9qj"]
Jul 09 17:31:08.474975 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.474956    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b8f9ccc9b-zd9qj"]
Jul 09 17:31:08.668822 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:08.668793    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1421f6cf-4a56-48ab-92ee-68b535eacecb" path="/var/lib/kubelet/pods/1421f6cf-4a56-48ab-92ee-68b535eacecb/volumes"
Jul 09 17:31:16.401026 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:16.400956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:16.499216 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:16.499173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:16.997801 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:16.997771    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"]
Jul 09 17:31:16.998028 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:16.998016    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1421f6cf-4a56-48ab-92ee-68b535eacecb" containerName="console"
Jul 09 17:31:16.998071 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:16.998029    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1421f6cf-4a56-48ab-92ee-68b535eacecb" containerName="console"
Jul 09 17:31:16.998131 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:16.998080    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1421f6cf-4a56-48ab-92ee-68b535eacecb" containerName="console"
Jul 09 17:31:17.002253 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.002235    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.005544 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.005525    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 17:31:17.006792 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.006774    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9r7r4\""
Jul 09 17:31:17.006887 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.006774    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 17:31:17.009971 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.009946    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"]
Jul 09 17:31:17.113114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.113089    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbkzr\" (UniqueName: \"kubernetes.io/projected/6f404a2e-21b8-46fc-b975-2a501b9f31eb-kube-api-access-fbkzr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.113255 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.113132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.113255 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.113152    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.213685 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.213660    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbkzr\" (UniqueName: \"kubernetes.io/projected/6f404a2e-21b8-46fc-b975-2a501b9f31eb-kube-api-access-fbkzr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.213796 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.213715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.213796 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.213745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.214082 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.214063    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.214147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.214103    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.230686 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.230668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbkzr\" (UniqueName: \"kubernetes.io/projected/6f404a2e-21b8-46fc-b975-2a501b9f31eb-kube-api-access-fbkzr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.312112 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.312052    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:17.433090 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.433068    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"]
Jul 09 17:31:17.435351 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:31:17.435320    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f404a2e_21b8_46fc_b975_2a501b9f31eb.slice/crio-54a9df9b5c4fc40b024718fcbb896802c7e36030dfd8f7fa5d79c9df7437bffe WatchSource:0}: Error finding container 54a9df9b5c4fc40b024718fcbb896802c7e36030dfd8f7fa5d79c9df7437bffe: Status 404 returned error can't find the container with id 54a9df9b5c4fc40b024718fcbb896802c7e36030dfd8f7fa5d79c9df7437bffe
Jul 09 17:31:17.489713 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:17.489686    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj" event={"ID":"6f404a2e-21b8-46fc-b975-2a501b9f31eb","Type":"ContainerStarted","Data":"54a9df9b5c4fc40b024718fcbb896802c7e36030dfd8f7fa5d79c9df7437bffe"}
Jul 09 17:31:24.518131 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:24.518095    2583 generic.go:356] "Generic (PLEG): container finished" podID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerID="95a6d1fa25dbdb7f848cd7fb87fc266ccfaf54aa5a5365b573237b6d9cda4dc3" exitCode=0
Jul 09 17:31:24.518580 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:24.518146    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj" event={"ID":"6f404a2e-21b8-46fc-b975-2a501b9f31eb","Type":"ContainerDied","Data":"95a6d1fa25dbdb7f848cd7fb87fc266ccfaf54aa5a5365b573237b6d9cda4dc3"}
Jul 09 17:31:27.533867 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:27.533834    2583 generic.go:356] "Generic (PLEG): container finished" podID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerID="2f7e076a53c4caa7039b526f6f97dd0f095304210db14425a818716f1ff288cf" exitCode=0
Jul 09 17:31:27.534253 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:27.533906    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj" event={"ID":"6f404a2e-21b8-46fc-b975-2a501b9f31eb","Type":"ContainerDied","Data":"2f7e076a53c4caa7039b526f6f97dd0f095304210db14425a818716f1ff288cf"}
Jul 09 17:31:30.980071 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:30.980010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:31.080469 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:31.080391    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:35.564181 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:35.564154    2583 generic.go:356] "Generic (PLEG): container finished" podID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerID="41899fa85859a1ee9e6859601fd165421368be6290d80ee6157c6c049882e850" exitCode=0
Jul 09 17:31:35.564493 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:35.564235    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj" event={"ID":"6f404a2e-21b8-46fc-b975-2a501b9f31eb","Type":"ContainerDied","Data":"41899fa85859a1ee9e6859601fd165421368be6290d80ee6157c6c049882e850"}
Jul 09 17:31:36.698778 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.698756    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:36.757303 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.757270    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-util\") pod \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") "
Jul 09 17:31:36.757484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.757316    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-bundle\") pod \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") "
Jul 09 17:31:36.757484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.757383    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbkzr\" (UniqueName: \"kubernetes.io/projected/6f404a2e-21b8-46fc-b975-2a501b9f31eb-kube-api-access-fbkzr\") pod \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\" (UID: \"6f404a2e-21b8-46fc-b975-2a501b9f31eb\") "
Jul 09 17:31:36.758000 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.757980    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-bundle" (OuterVolumeSpecName: "bundle") pod "6f404a2e-21b8-46fc-b975-2a501b9f31eb" (UID: "6f404a2e-21b8-46fc-b975-2a501b9f31eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:31:36.759434 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.759417    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f404a2e-21b8-46fc-b975-2a501b9f31eb-kube-api-access-fbkzr" (OuterVolumeSpecName: "kube-api-access-fbkzr") pod "6f404a2e-21b8-46fc-b975-2a501b9f31eb" (UID: "6f404a2e-21b8-46fc-b975-2a501b9f31eb"). InnerVolumeSpecName "kube-api-access-fbkzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:31:36.761908 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.761887    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-util" (OuterVolumeSpecName: "util") pod "6f404a2e-21b8-46fc-b975-2a501b9f31eb" (UID: "6f404a2e-21b8-46fc-b975-2a501b9f31eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:31:36.858031 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.858010    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-util\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:36.858031 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.858032    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f404a2e-21b8-46fc-b975-2a501b9f31eb-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:36.858168 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:36.858041    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbkzr\" (UniqueName: \"kubernetes.io/projected/6f404a2e-21b8-46fc-b975-2a501b9f31eb-kube-api-access-fbkzr\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:37.574413 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:37.574380    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj" event={"ID":"6f404a2e-21b8-46fc-b975-2a501b9f31eb","Type":"ContainerDied","Data":"54a9df9b5c4fc40b024718fcbb896802c7e36030dfd8f7fa5d79c9df7437bffe"}
Jul 09 17:31:37.574584 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:37.574414    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nr6fj"
Jul 09 17:31:37.574584 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:37.574457    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54a9df9b5c4fc40b024718fcbb896802c7e36030dfd8f7fa5d79c9df7437bffe"
Jul 09 17:31:42.833764 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:42.833734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:44.232507 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.232457    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:44.852048 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.852018    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"]
Jul 09 17:31:44.852311 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.852298    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerName="util"
Jul 09 17:31:44.852365 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.852312    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerName="util"
Jul 09 17:31:44.852365 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.852322    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerName="pull"
Jul 09 17:31:44.852365 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.852328    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerName="pull"
Jul 09 17:31:44.852365 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.852339    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerName="extract"
Jul 09 17:31:44.852365 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.852345    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerName="extract"
Jul 09 17:31:44.852507 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.852388    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f404a2e-21b8-46fc-b975-2a501b9f31eb" containerName="extract"
Jul 09 17:31:44.856827 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.856810    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"
Jul 09 17:31:44.860519 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.860499    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 17:31:44.860640 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.860505    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:31:44.860694 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.860504    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xvkvk\""
Jul 09 17:31:44.872972 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.872951    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"]
Jul 09 17:31:44.909570 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.909548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63eada9e-c7c9-440f-b4fb-fc669b42a41d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pdv28\" (UID: \"63eada9e-c7c9-440f-b4fb-fc669b42a41d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"
Jul 09 17:31:44.909649 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:44.909588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw9b8\" (UniqueName: \"kubernetes.io/projected/63eada9e-c7c9-440f-b4fb-fc669b42a41d-kube-api-access-zw9b8\") pod \"cert-manager-operator-controller-manager-55c444bf86-pdv28\" (UID: \"63eada9e-c7c9-440f-b4fb-fc669b42a41d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"
Jul 09 17:31:45.009824 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:45.009802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63eada9e-c7c9-440f-b4fb-fc669b42a41d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pdv28\" (UID: \"63eada9e-c7c9-440f-b4fb-fc669b42a41d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"
Jul 09 17:31:45.009905 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:45.009841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw9b8\" (UniqueName: \"kubernetes.io/projected/63eada9e-c7c9-440f-b4fb-fc669b42a41d-kube-api-access-zw9b8\") pod \"cert-manager-operator-controller-manager-55c444bf86-pdv28\" (UID: \"63eada9e-c7c9-440f-b4fb-fc669b42a41d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"
Jul 09 17:31:45.010152 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:45.010135    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63eada9e-c7c9-440f-b4fb-fc669b42a41d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pdv28\" (UID: \"63eada9e-c7c9-440f-b4fb-fc669b42a41d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"
Jul 09 17:31:45.019933 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:45.019907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw9b8\" (UniqueName: \"kubernetes.io/projected/63eada9e-c7c9-440f-b4fb-fc669b42a41d-kube-api-access-zw9b8\") pod \"cert-manager-operator-controller-manager-55c444bf86-pdv28\" (UID: \"63eada9e-c7c9-440f-b4fb-fc669b42a41d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"
Jul 09 17:31:45.166031 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:45.165969    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"
Jul 09 17:31:45.301711 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:45.301685    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28"]
Jul 09 17:31:45.303819 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:31:45.303780    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63eada9e_c7c9_440f_b4fb_fc669b42a41d.slice/crio-5f8c43c0a7db1faad004fdb21e28d56e58595114dd12de8777edbb4d41058c19 WatchSource:0}: Error finding container 5f8c43c0a7db1faad004fdb21e28d56e58595114dd12de8777edbb4d41058c19: Status 404 returned error can't find the container with id 5f8c43c0a7db1faad004fdb21e28d56e58595114dd12de8777edbb4d41058c19
Jul 09 17:31:45.603568 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:45.603531    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28" event={"ID":"63eada9e-c7c9-440f-b4fb-fc669b42a41d","Type":"ContainerStarted","Data":"5f8c43c0a7db1faad004fdb21e28d56e58595114dd12de8777edbb4d41058c19"}
Jul 09 17:31:46.442834 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:46.442744    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:46.544044 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:46.544001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:47.615809 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:47.615764    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28" event={"ID":"63eada9e-c7c9-440f-b4fb-fc669b42a41d","Type":"ContainerStarted","Data":"69b177ea0a9b60565f2ef255a160a793beaeb9e19b17b8b23476a752ade81d27"}
Jul 09 17:31:47.636717 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:47.636677    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pdv28" podStartSLOduration=2.063593134 podStartE2EDuration="3.636662188s" totalImagesPullingTime="1.573069054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:31:47.635262957 +0000 UTC m=+231.417982288" watchObservedRunningTime="2026-07-09 17:31:47.636662188 +0000 UTC m=+231.419381497"
Jul 09 17:31:48.065169 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.065088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:48.212266 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.212235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:48.691771 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.691733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:48.801813 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.801786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:48.859337 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.859315    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"]
Jul 09 17:31:48.862575 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.862561    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:48.865454 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.865439    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 17:31:48.866816 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.866798    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9r7r4\""
Jul 09 17:31:48.866903 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.866814    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 17:31:48.869907 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.869887    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"]
Jul 09 17:31:48.934765 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.934741    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:48.934859 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.934779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:48.934859 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:48.934815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsgs2\" (UniqueName: \"kubernetes.io/projected/efae7b7b-0cae-431a-9a29-f322cc9166c1-kube-api-access-wsgs2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:49.036143 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.036095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:49.036143 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.036128    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsgs2\" (UniqueName: \"kubernetes.io/projected/efae7b7b-0cae-431a-9a29-f322cc9166c1-kube-api-access-wsgs2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:49.036291 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.036165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:49.036497 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.036480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:49.036532 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.036492    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:49.044953 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.044929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsgs2\" (UniqueName: \"kubernetes.io/projected/efae7b7b-0cae-431a-9a29-f322cc9166c1-kube-api-access-wsgs2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:49.171626 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.171603    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:49.291678 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.291592    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"]
Jul 09 17:31:49.293882 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:31:49.293857    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefae7b7b_0cae_431a_9a29_f322cc9166c1.slice/crio-26820046bfb417146c8effff15074f5607b853e94240d559939b4d9509b642f7 WatchSource:0}: Error finding container 26820046bfb417146c8effff15074f5607b853e94240d559939b4d9509b642f7: Status 404 returned error can't find the container with id 26820046bfb417146c8effff15074f5607b853e94240d559939b4d9509b642f7
Jul 09 17:31:49.625036 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.625008    2583 generic.go:356] "Generic (PLEG): container finished" podID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerID="a7713970ca390c4f8da347aba27d30bb55dbb4e7323a88537bb5e31c4504ccd2" exitCode=0
Jul 09 17:31:49.625216 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.625067    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv" event={"ID":"efae7b7b-0cae-431a-9a29-f322cc9166c1","Type":"ContainerDied","Data":"a7713970ca390c4f8da347aba27d30bb55dbb4e7323a88537bb5e31c4504ccd2"}
Jul 09 17:31:49.625216 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:49.625104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv" event={"ID":"efae7b7b-0cae-431a-9a29-f322cc9166c1","Type":"ContainerStarted","Data":"26820046bfb417146c8effff15074f5607b853e94240d559939b4d9509b642f7"}
Jul 09 17:31:50.698424 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:50.698388    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:50.979785 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:50.979718    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"]
Jul 09 17:31:50.984506 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:50.984487    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"
Jul 09 17:31:50.987828 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:50.987799    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gnl8s\""
Jul 09 17:31:50.987930 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:50.987809    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 17:31:50.989437 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:50.989417    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 17:31:50.991415 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:50.991391    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"]
Jul 09 17:31:51.053611 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:51.053582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjnwd\" (UniqueName: \"kubernetes.io/projected/eea09e2b-6a0f-49d6-b1c9-873e0d5cc715-kube-api-access-zjnwd\") pod \"cert-manager-cainjector-559cdd8c87-79z8g\" (UID: \"eea09e2b-6a0f-49d6-b1c9-873e0d5cc715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"
Jul 09 17:31:51.053740 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:51.053634    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eea09e2b-6a0f-49d6-b1c9-873e0d5cc715-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-79z8g\" (UID: \"eea09e2b-6a0f-49d6-b1c9-873e0d5cc715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"
Jul 09 17:31:51.096904 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:51.096865    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:51.154990 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:51.154959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjnwd\" (UniqueName: \"kubernetes.io/projected/eea09e2b-6a0f-49d6-b1c9-873e0d5cc715-kube-api-access-zjnwd\") pod \"cert-manager-cainjector-559cdd8c87-79z8g\" (UID: \"eea09e2b-6a0f-49d6-b1c9-873e0d5cc715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"
Jul 09 17:31:51.155123 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:51.155018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eea09e2b-6a0f-49d6-b1c9-873e0d5cc715-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-79z8g\" (UID: \"eea09e2b-6a0f-49d6-b1c9-873e0d5cc715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"
Jul 09 17:31:51.163416 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:51.163389    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eea09e2b-6a0f-49d6-b1c9-873e0d5cc715-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-79z8g\" (UID: \"eea09e2b-6a0f-49d6-b1c9-873e0d5cc715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"
Jul 09 17:31:51.163513 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:51.163417    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjnwd\" (UniqueName: \"kubernetes.io/projected/eea09e2b-6a0f-49d6-b1c9-873e0d5cc715-kube-api-access-zjnwd\") pod \"cert-manager-cainjector-559cdd8c87-79z8g\" (UID: \"eea09e2b-6a0f-49d6-b1c9-873e0d5cc715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"
Jul 09 17:31:51.303037 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:51.302968    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"
Jul 09 17:31:51.740934 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:51.740913    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-79z8g"]
Jul 09 17:31:51.743519 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:31:51.743494    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeea09e2b_6a0f_49d6_b1c9_873e0d5cc715.slice/crio-22f096796cd1a9462e0ca3135cb52c3add059164357d64f56901315461ff4a60 WatchSource:0}: Error finding container 22f096796cd1a9462e0ca3135cb52c3add059164357d64f56901315461ff4a60: Status 404 returned error can't find the container with id 22f096796cd1a9462e0ca3135cb52c3add059164357d64f56901315461ff4a60
Jul 09 17:31:52.640527 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:52.640489    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g" event={"ID":"eea09e2b-6a0f-49d6-b1c9-873e0d5cc715","Type":"ContainerStarted","Data":"22f096796cd1a9462e0ca3135cb52c3add059164357d64f56901315461ff4a60"}
Jul 09 17:31:52.642135 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:52.642106    2583 generic.go:356] "Generic (PLEG): container finished" podID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerID="3ebac90cfa1332384421ce7e6fc14cec06a2e5e277415c787afef118a01880f0" exitCode=0
Jul 09 17:31:52.642289 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:52.642145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv" event={"ID":"efae7b7b-0cae-431a-9a29-f322cc9166c1","Type":"ContainerDied","Data":"3ebac90cfa1332384421ce7e6fc14cec06a2e5e277415c787afef118a01880f0"}
Jul 09 17:31:53.444415 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:53.444362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:53.534229 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:53.534181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:53.649078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:53.649045    2583 generic.go:356] "Generic (PLEG): container finished" podID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerID="cba6207df004fad1f36512b2567ede86ab8a9a9ff15b0582b31d86058f538afd" exitCode=0
Jul 09 17:31:53.649246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:53.649116    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv" event={"ID":"efae7b7b-0cae-431a-9a29-f322cc9166c1","Type":"ContainerDied","Data":"cba6207df004fad1f36512b2567ede86ab8a9a9ff15b0582b31d86058f538afd"}
Jul 09 17:31:54.984362 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:54.984338    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:55.086925 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.086903    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsgs2\" (UniqueName: \"kubernetes.io/projected/efae7b7b-0cae-431a-9a29-f322cc9166c1-kube-api-access-wsgs2\") pod \"efae7b7b-0cae-431a-9a29-f322cc9166c1\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") "
Jul 09 17:31:55.087058 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.086944    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-bundle\") pod \"efae7b7b-0cae-431a-9a29-f322cc9166c1\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") "
Jul 09 17:31:55.087058 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.087008    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-util\") pod \"efae7b7b-0cae-431a-9a29-f322cc9166c1\" (UID: \"efae7b7b-0cae-431a-9a29-f322cc9166c1\") "
Jul 09 17:31:55.087372 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.087345    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-bundle" (OuterVolumeSpecName: "bundle") pod "efae7b7b-0cae-431a-9a29-f322cc9166c1" (UID: "efae7b7b-0cae-431a-9a29-f322cc9166c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:31:55.089051 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.089028    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efae7b7b-0cae-431a-9a29-f322cc9166c1-kube-api-access-wsgs2" (OuterVolumeSpecName: "kube-api-access-wsgs2") pod "efae7b7b-0cae-431a-9a29-f322cc9166c1" (UID: "efae7b7b-0cae-431a-9a29-f322cc9166c1"). InnerVolumeSpecName "kube-api-access-wsgs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:31:55.091447 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.091422    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-util" (OuterVolumeSpecName: "util") pod "efae7b7b-0cae-431a-9a29-f322cc9166c1" (UID: "efae7b7b-0cae-431a-9a29-f322cc9166c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:31:55.188151 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.188122    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-util\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:55.188151 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.188146    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsgs2\" (UniqueName: \"kubernetes.io/projected/efae7b7b-0cae-431a-9a29-f322cc9166c1-kube-api-access-wsgs2\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:55.188151 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.188157    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efae7b7b-0cae-431a-9a29-f322cc9166c1-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:31:55.661089 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.661058    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv"
Jul 09 17:31:55.661089 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.661073    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lgxv" event={"ID":"efae7b7b-0cae-431a-9a29-f322cc9166c1","Type":"ContainerDied","Data":"26820046bfb417146c8effff15074f5607b853e94240d559939b4d9509b642f7"}
Jul 09 17:31:55.661318 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.661130    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26820046bfb417146c8effff15074f5607b853e94240d559939b4d9509b642f7"
Jul 09 17:31:55.662567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.662543    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g" event={"ID":"eea09e2b-6a0f-49d6-b1c9-873e0d5cc715","Type":"ContainerStarted","Data":"3ee4f14ddf931abe4e1f980982e0e5d72c47f19df789ea2fb4306be0f60a4bfd"}
Jul 09 17:31:55.680272 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.680222    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-79z8g" podStartSLOduration=2.391585317 podStartE2EDuration="5.680187934s" totalImagesPullingTime="3.288602617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:31:55.677871974 +0000 UTC m=+239.460591303" watchObservedRunningTime="2026-07-09 17:31:55.680187934 +0000 UTC m=+239.462907266"
Jul 09 17:31:55.821605 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.821575    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:55.873896 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:55.873867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:59.279728 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.279696    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-25pxp"]
Jul 09 17:31:59.280078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.279982    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerName="extract"
Jul 09 17:31:59.280078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.279993    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerName="extract"
Jul 09 17:31:59.280078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.280000    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerName="util"
Jul 09 17:31:59.280078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.280006    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerName="util"
Jul 09 17:31:59.280078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.280014    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerName="pull"
Jul 09 17:31:59.280078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.280019    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerName="pull"
Jul 09 17:31:59.280078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.280066    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="efae7b7b-0cae-431a-9a29-f322cc9166c1" containerName="extract"
Jul 09 17:31:59.284138 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.284120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-25pxp"
Jul 09 17:31:59.286936 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.286917    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gj9cd\""
Jul 09 17:31:59.291793 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.291772    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-25pxp"]
Jul 09 17:31:59.297695 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.297676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:31:59.418414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.418388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4086af8f-ef2d-49ed-a50c-05d05bba6b0b-bound-sa-token\") pod \"cert-manager-55b4d954d5-25pxp\" (UID: \"4086af8f-ef2d-49ed-a50c-05d05bba6b0b\") " pod="cert-manager/cert-manager-55b4d954d5-25pxp"
Jul 09 17:31:59.418537 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.418423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxfrf\" (UniqueName: \"kubernetes.io/projected/4086af8f-ef2d-49ed-a50c-05d05bba6b0b-kube-api-access-kxfrf\") pod \"cert-manager-55b4d954d5-25pxp\" (UID: \"4086af8f-ef2d-49ed-a50c-05d05bba6b0b\") " pod="cert-manager/cert-manager-55b4d954d5-25pxp"
Jul 09 17:31:59.519364 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.519336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4086af8f-ef2d-49ed-a50c-05d05bba6b0b-bound-sa-token\") pod \"cert-manager-55b4d954d5-25pxp\" (UID: \"4086af8f-ef2d-49ed-a50c-05d05bba6b0b\") " pod="cert-manager/cert-manager-55b4d954d5-25pxp"
Jul 09 17:31:59.519485 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.519374    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxfrf\" (UniqueName: \"kubernetes.io/projected/4086af8f-ef2d-49ed-a50c-05d05bba6b0b-kube-api-access-kxfrf\") pod \"cert-manager-55b4d954d5-25pxp\" (UID: \"4086af8f-ef2d-49ed-a50c-05d05bba6b0b\") " pod="cert-manager/cert-manager-55b4d954d5-25pxp"
Jul 09 17:31:59.528106 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.528075    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4086af8f-ef2d-49ed-a50c-05d05bba6b0b-bound-sa-token\") pod \"cert-manager-55b4d954d5-25pxp\" (UID: \"4086af8f-ef2d-49ed-a50c-05d05bba6b0b\") " pod="cert-manager/cert-manager-55b4d954d5-25pxp"
Jul 09 17:31:59.528106 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.528095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxfrf\" (UniqueName: \"kubernetes.io/projected/4086af8f-ef2d-49ed-a50c-05d05bba6b0b-kube-api-access-kxfrf\") pod \"cert-manager-55b4d954d5-25pxp\" (UID: \"4086af8f-ef2d-49ed-a50c-05d05bba6b0b\") " pod="cert-manager/cert-manager-55b4d954d5-25pxp"
Jul 09 17:31:59.592746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.592717    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-25pxp"
Jul 09 17:31:59.713842 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:31:59.713819    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-25pxp"]
Jul 09 17:31:59.716349 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:31:59.716324    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4086af8f_ef2d_49ed_a50c_05d05bba6b0b.slice/crio-742b2639f7755da175494376d46ddad985d293cfa20eead2b7403cb1d2cd284f WatchSource:0}: Error finding container 742b2639f7755da175494376d46ddad985d293cfa20eead2b7403cb1d2cd284f: Status 404 returned error can't find the container with id 742b2639f7755da175494376d46ddad985d293cfa20eead2b7403cb1d2cd284f
Jul 09 17:32:00.683037 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:00.683007    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-25pxp" event={"ID":"4086af8f-ef2d-49ed-a50c-05d05bba6b0b","Type":"ContainerStarted","Data":"197cf9187a5a2aa5591e922531f9b94d7b36c876d4b6f4236a3308ccec351235"}
Jul 09 17:32:00.683037 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:00.683042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-25pxp" event={"ID":"4086af8f-ef2d-49ed-a50c-05d05bba6b0b","Type":"ContainerStarted","Data":"742b2639f7755da175494376d46ddad985d293cfa20eead2b7403cb1d2cd284f"}
Jul 09 17:32:00.698162 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:00.698117    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-25pxp" podStartSLOduration=1.6980985990000002 podStartE2EDuration="1.698098599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:31:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:00.697780864 +0000 UTC m=+244.480500196" watchObservedRunningTime="2026-07-09 17:32:00.698098599 +0000 UTC m=+244.480817930"
Jul 09 17:32:01.146584 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:01.146553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:01.246135 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:01.246089    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:04.325489 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:04.325453    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:04.426260 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:04.426229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:06.777444 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:06.777410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:06.881773 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:06.881721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:08.530128 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.530098    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"]
Jul 09 17:32:08.546825 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.546796    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"]
Jul 09 17:32:08.546979 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.546839    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.549674 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.549653    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 17:32:08.549818 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.549690    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 17:32:08.551105 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.551086    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9r7r4\""
Jul 09 17:32:08.677149 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.677122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:08.685261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.685241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7vfd\" (UniqueName: \"kubernetes.io/projected/94cc1cc6-bb14-4178-848d-21585138c9e3-kube-api-access-n7vfd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.685332 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.685274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.685377 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.685333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.786562 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.786502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.786562 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.786542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7vfd\" (UniqueName: \"kubernetes.io/projected/94cc1cc6-bb14-4178-848d-21585138c9e3-kube-api-access-n7vfd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.786684 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.786563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.786864 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.786848    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.786900 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.786869    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.794930 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.794907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7vfd\" (UniqueName: \"kubernetes.io/projected/94cc1cc6-bb14-4178-848d-21585138c9e3-kube-api-access-n7vfd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:08.860438 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:08.856129    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:09.009307 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:09.009278    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"]
Jul 09 17:32:09.012353 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:32:09.012327    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94cc1cc6_bb14_4178_848d_21585138c9e3.slice/crio-3ebfa4af3dbd2d1f24d809a907c14b545ae7a5352c6cbaf1af9fad2fe2b9a313 WatchSource:0}: Error finding container 3ebfa4af3dbd2d1f24d809a907c14b545ae7a5352c6cbaf1af9fad2fe2b9a313: Status 404 returned error can't find the container with id 3ebfa4af3dbd2d1f24d809a907c14b545ae7a5352c6cbaf1af9fad2fe2b9a313
Jul 09 17:32:09.718007 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:09.717975    2583 generic.go:356] "Generic (PLEG): container finished" podID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerID="3478fec4ce1febd4d7e90283bc95b1e1fc288f6042a6cc3cf80d9aa54632cbfa" exitCode=0
Jul 09 17:32:09.718406 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:09.718055    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz" event={"ID":"94cc1cc6-bb14-4178-848d-21585138c9e3","Type":"ContainerDied","Data":"3478fec4ce1febd4d7e90283bc95b1e1fc288f6042a6cc3cf80d9aa54632cbfa"}
Jul 09 17:32:09.718406 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:09.718098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz" event={"ID":"94cc1cc6-bb14-4178-848d-21585138c9e3","Type":"ContainerStarted","Data":"3ebfa4af3dbd2d1f24d809a907c14b545ae7a5352c6cbaf1af9fad2fe2b9a313"}
Jul 09 17:32:11.727564 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:11.727518    2583 generic.go:356] "Generic (PLEG): container finished" podID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerID="b94c1864ed5783448a3b9f3f793a25abb0e2b515dc723e503891b976ffa5e4fd" exitCode=0
Jul 09 17:32:11.727938 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:11.727591    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz" event={"ID":"94cc1cc6-bb14-4178-848d-21585138c9e3","Type":"ContainerDied","Data":"b94c1864ed5783448a3b9f3f793a25abb0e2b515dc723e503891b976ffa5e4fd"}
Jul 09 17:32:12.733173 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:12.733141    2583 generic.go:356] "Generic (PLEG): container finished" podID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerID="dce26261a876963f30369cf2ae40a98cf9a21e070eaa958144285b4838503bab" exitCode=0
Jul 09 17:32:12.733553 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:12.733233    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz" event={"ID":"94cc1cc6-bb14-4178-848d-21585138c9e3","Type":"ContainerDied","Data":"dce26261a876963f30369cf2ae40a98cf9a21e070eaa958144285b4838503bab"}
Jul 09 17:32:13.862155 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:13.862132    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:14.021827 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.021763    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7vfd\" (UniqueName: \"kubernetes.io/projected/94cc1cc6-bb14-4178-848d-21585138c9e3-kube-api-access-n7vfd\") pod \"94cc1cc6-bb14-4178-848d-21585138c9e3\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") "
Jul 09 17:32:14.021827 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.021804    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-util\") pod \"94cc1cc6-bb14-4178-848d-21585138c9e3\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") "
Jul 09 17:32:14.022013 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.021833    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-bundle\") pod \"94cc1cc6-bb14-4178-848d-21585138c9e3\" (UID: \"94cc1cc6-bb14-4178-848d-21585138c9e3\") "
Jul 09 17:32:14.022540 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.022515    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-bundle" (OuterVolumeSpecName: "bundle") pod "94cc1cc6-bb14-4178-848d-21585138c9e3" (UID: "94cc1cc6-bb14-4178-848d-21585138c9e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:32:14.023797 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.023776    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94cc1cc6-bb14-4178-848d-21585138c9e3-kube-api-access-n7vfd" (OuterVolumeSpecName: "kube-api-access-n7vfd") pod "94cc1cc6-bb14-4178-848d-21585138c9e3" (UID: "94cc1cc6-bb14-4178-848d-21585138c9e3"). InnerVolumeSpecName "kube-api-access-n7vfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:32:14.027416 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.027397    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-util" (OuterVolumeSpecName: "util") pod "94cc1cc6-bb14-4178-848d-21585138c9e3" (UID: "94cc1cc6-bb14-4178-848d-21585138c9e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:32:14.123174 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.123142    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-util\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:14.123174 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.123172    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cc1cc6-bb14-4178-848d-21585138c9e3-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:14.123174 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.123180    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7vfd\" (UniqueName: \"kubernetes.io/projected/94cc1cc6-bb14-4178-848d-21585138c9e3-kube-api-access-n7vfd\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:14.742605 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.742571    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz" event={"ID":"94cc1cc6-bb14-4178-848d-21585138c9e3","Type":"ContainerDied","Data":"3ebfa4af3dbd2d1f24d809a907c14b545ae7a5352c6cbaf1af9fad2fe2b9a313"}
Jul 09 17:32:14.742771 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.742608    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjc5pz"
Jul 09 17:32:14.742771 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:14.742616    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ebfa4af3dbd2d1f24d809a907c14b545ae7a5352c6cbaf1af9fad2fe2b9a313"
Jul 09 17:32:24.676337 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:24.676130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:25.572097 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.572065    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"]
Jul 09 17:32:25.572366 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.572354    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerName="pull"
Jul 09 17:32:25.572413 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.572368    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerName="pull"
Jul 09 17:32:25.572413 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.572379    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerName="extract"
Jul 09 17:32:25.572413 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.572384    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerName="extract"
Jul 09 17:32:25.572413 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.572401    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerName="util"
Jul 09 17:32:25.572413 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.572407    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerName="util"
Jul 09 17:32:25.572557 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.572453    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="94cc1cc6-bb14-4178-848d-21585138c9e3" containerName="extract"
Jul 09 17:32:25.577959 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.577934    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.580763 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.580739    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 17:32:25.580922 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.580786    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 17:32:25.581037 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.580982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 17:32:25.581102 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.581039    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-94t5d\""
Jul 09 17:32:25.581155 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.581106    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 17:32:25.589121 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.589102    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"]
Jul 09 17:32:25.703071 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.703051    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nlf7\" (UniqueName: \"kubernetes.io/projected/12fc840b-d09a-42f9-8e89-f84559747e59-kube-api-access-2nlf7\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.703410 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.703083    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12fc840b-d09a-42f9-8e89-f84559747e59-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.703410 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.703101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12fc840b-d09a-42f9-8e89-f84559747e59-tmp\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.703410 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.703116    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12fc840b-d09a-42f9-8e89-f84559747e59-webhook-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.703410 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.703270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12fc840b-d09a-42f9-8e89-f84559747e59-manifests\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.804076 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.804049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12fc840b-d09a-42f9-8e89-f84559747e59-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.804076 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.804078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12fc840b-d09a-42f9-8e89-f84559747e59-tmp\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.804250 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.804096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12fc840b-d09a-42f9-8e89-f84559747e59-webhook-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.804250 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.804137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12fc840b-d09a-42f9-8e89-f84559747e59-manifests\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.804250 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.804230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nlf7\" (UniqueName: \"kubernetes.io/projected/12fc840b-d09a-42f9-8e89-f84559747e59-kube-api-access-2nlf7\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.804585 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.804564    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12fc840b-d09a-42f9-8e89-f84559747e59-manifests\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.806213 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.806183    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12fc840b-d09a-42f9-8e89-f84559747e59-tmp\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.806435 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.806418    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12fc840b-d09a-42f9-8e89-f84559747e59-webhook-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.806501 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.806468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12fc840b-d09a-42f9-8e89-f84559747e59-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.813372 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.813353    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nlf7\" (UniqueName: \"kubernetes.io/projected/12fc840b-d09a-42f9-8e89-f84559747e59-kube-api-access-2nlf7\") pod \"opendatahub-operator-controller-manager-c8444b686-vsw6g\" (UID: \"12fc840b-d09a-42f9-8e89-f84559747e59\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:25.888311 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:25.888290    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:26.018429 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:26.018406    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"]
Jul 09 17:32:26.020687 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:32:26.020652    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fc840b_d09a_42f9_8e89_f84559747e59.slice/crio-c175a88022b1945a3c329b89374f54b91b2100d9b0dce10046145f719d5b7326 WatchSource:0}: Error finding container c175a88022b1945a3c329b89374f54b91b2100d9b0dce10046145f719d5b7326: Status 404 returned error can't find the container with id c175a88022b1945a3c329b89374f54b91b2100d9b0dce10046145f719d5b7326
Jul 09 17:32:26.343695 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:26.343652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:26.792972 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:26.792892    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g" event={"ID":"12fc840b-d09a-42f9-8e89-f84559747e59","Type":"ContainerStarted","Data":"c175a88022b1945a3c329b89374f54b91b2100d9b0dce10046145f719d5b7326"}
Jul 09 17:32:29.807790 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:29.807752    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g" event={"ID":"12fc840b-d09a-42f9-8e89-f84559747e59","Type":"ContainerStarted","Data":"9116f873a3059572cba9c69783a85be06174ea8463a7a21a8f61b66ad42367e5"}
Jul 09 17:32:30.813611 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:30.813573    2583 generic.go:356] "Generic (PLEG): container finished" podID="12fc840b-d09a-42f9-8e89-f84559747e59" containerID="9116f873a3059572cba9c69783a85be06174ea8463a7a21a8f61b66ad42367e5" exitCode=0
Jul 09 17:32:30.814016 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:30.813649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g" event={"ID":"12fc840b-d09a-42f9-8e89-f84559747e59","Type":"ContainerDied","Data":"9116f873a3059572cba9c69783a85be06174ea8463a7a21a8f61b66ad42367e5"}
Jul 09 17:32:31.819389 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:31.819314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g" event={"ID":"12fc840b-d09a-42f9-8e89-f84559747e59","Type":"ContainerStarted","Data":"5434a5610afb28de92508612ce8a1bdeaeaa4847438c388be486b42c964d2195"}
Jul 09 17:32:31.819719 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:31.819417    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:31.842121 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:31.842082    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g" podStartSLOduration=2.011990036 podStartE2EDuration="6.842068481s" totalImagesPullingTime="3.794443156s" totalInitContainerRuntime="1.035635289s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:31.840378915 +0000 UTC m=+275.623098247" watchObservedRunningTime="2026-07-09 17:32:31.842068481 +0000 UTC m=+275.624787812"
Jul 09 17:32:34.863989 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:34.863949    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:34.964666 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:34.964633    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:37.486025 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:37.485995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:37.600369 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:37.600340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:42.825101 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:42.825063    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-vsw6g"
Jul 09 17:32:44.931581 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:44.931541    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:45.027319 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.027282    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:45.147102 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.147070    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:45.206856 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.206777    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"]
Jul 09 17:32:45.214897 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.214871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.218465 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.218437    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5g6mp\""
Jul 09 17:32:45.218465 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.218449    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 17:32:45.219875 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.219852    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 17:32:45.219875 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.219874    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 17:32:45.220023 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.219887    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 17:32:45.224331 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.224311    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"]
Jul 09 17:32:45.246991 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.246969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a5b1c77-0e75-4bd1-927c-249c40beeca6-tls-certs\") pod \"kube-auth-proxy-85cbbdb477-zgzdg\" (UID: \"4a5b1c77-0e75-4bd1-927c-249c40beeca6\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.247086 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.246998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsvn5\" (UniqueName: \"kubernetes.io/projected/4a5b1c77-0e75-4bd1-927c-249c40beeca6-kube-api-access-tsvn5\") pod \"kube-auth-proxy-85cbbdb477-zgzdg\" (UID: \"4a5b1c77-0e75-4bd1-927c-249c40beeca6\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.247086 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.247019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a5b1c77-0e75-4bd1-927c-249c40beeca6-tmp\") pod \"kube-auth-proxy-85cbbdb477-zgzdg\" (UID: \"4a5b1c77-0e75-4bd1-927c-249c40beeca6\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.345393 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.345365    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:45.347313 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.347294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a5b1c77-0e75-4bd1-927c-249c40beeca6-tls-certs\") pod \"kube-auth-proxy-85cbbdb477-zgzdg\" (UID: \"4a5b1c77-0e75-4bd1-927c-249c40beeca6\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.347374 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.347327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsvn5\" (UniqueName: \"kubernetes.io/projected/4a5b1c77-0e75-4bd1-927c-249c40beeca6-kube-api-access-tsvn5\") pod \"kube-auth-proxy-85cbbdb477-zgzdg\" (UID: \"4a5b1c77-0e75-4bd1-927c-249c40beeca6\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.347374 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.347347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a5b1c77-0e75-4bd1-927c-249c40beeca6-tmp\") pod \"kube-auth-proxy-85cbbdb477-zgzdg\" (UID: \"4a5b1c77-0e75-4bd1-927c-249c40beeca6\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.349561 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.349538    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a5b1c77-0e75-4bd1-927c-249c40beeca6-tmp\") pod \"kube-auth-proxy-85cbbdb477-zgzdg\" (UID: \"4a5b1c77-0e75-4bd1-927c-249c40beeca6\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.349716 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.349703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a5b1c77-0e75-4bd1-927c-249c40beeca6-tls-certs\") pod \"kube-auth-proxy-85cbbdb477-zgzdg\" (UID: \"4a5b1c77-0e75-4bd1-927c-249c40beeca6\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.356332 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.356312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsvn5\" (UniqueName: \"kubernetes.io/projected/4a5b1c77-0e75-4bd1-927c-249c40beeca6-kube-api-access-tsvn5\") pod \"kube-auth-proxy-85cbbdb477-zgzdg\" (UID: \"4a5b1c77-0e75-4bd1-927c-249c40beeca6\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.524407 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.524351    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"
Jul 09 17:32:45.597032 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.597007    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rxl9l"]
Jul 09 17:32:45.600459 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.600438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:45.604086 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.603912    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 17:32:45.604281 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.604240    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-j4vwb\""
Jul 09 17:32:45.612533 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.612462    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rxl9l"]
Jul 09 17:32:45.640794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.640768    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:45.649547 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.649521    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bzc7\" (UniqueName: \"kubernetes.io/projected/9eab3ad5-4245-447f-b1c5-a0cc2380d87c-kube-api-access-4bzc7\") pod \"odh-model-controller-7998c67dc4-rxl9l\" (UID: \"9eab3ad5-4245-447f-b1c5-a0cc2380d87c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:45.649650 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.649550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eab3ad5-4245-447f-b1c5-a0cc2380d87c-cert\") pod \"odh-model-controller-7998c67dc4-rxl9l\" (UID: \"9eab3ad5-4245-447f-b1c5-a0cc2380d87c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:45.655599 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.655542    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg"]
Jul 09 17:32:45.657762 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:32:45.657736    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5b1c77_0e75_4bd1_927c_249c40beeca6.slice/crio-7e4c908a960515a67608714b043d77e7554a23e4612062ddecd220ebb98f124b WatchSource:0}: Error finding container 7e4c908a960515a67608714b043d77e7554a23e4612062ddecd220ebb98f124b: Status 404 returned error can't find the container with id 7e4c908a960515a67608714b043d77e7554a23e4612062ddecd220ebb98f124b
Jul 09 17:32:45.714859 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.714828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:45.750012 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.749991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bzc7\" (UniqueName: \"kubernetes.io/projected/9eab3ad5-4245-447f-b1c5-a0cc2380d87c-kube-api-access-4bzc7\") pod \"odh-model-controller-7998c67dc4-rxl9l\" (UID: \"9eab3ad5-4245-447f-b1c5-a0cc2380d87c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:45.750114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.750020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eab3ad5-4245-447f-b1c5-a0cc2380d87c-cert\") pod \"odh-model-controller-7998c67dc4-rxl9l\" (UID: \"9eab3ad5-4245-447f-b1c5-a0cc2380d87c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:45.750265 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:32:45.750248    2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 17:32:45.750335 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:32:45.750328    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9eab3ad5-4245-447f-b1c5-a0cc2380d87c-cert podName:9eab3ad5-4245-447f-b1c5-a0cc2380d87c nodeName:}" failed. No retries permitted until 2026-07-09 17:32:46.250306759 +0000 UTC m=+290.033026074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9eab3ad5-4245-447f-b1c5-a0cc2380d87c-cert") pod "odh-model-controller-7998c67dc4-rxl9l" (UID: "9eab3ad5-4245-447f-b1c5-a0cc2380d87c") : secret "odh-model-controller-webhook-cert" not found
Jul 09 17:32:45.762980 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.762961    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bzc7\" (UniqueName: \"kubernetes.io/projected/9eab3ad5-4245-447f-b1c5-a0cc2380d87c-kube-api-access-4bzc7\") pod \"odh-model-controller-7998c67dc4-rxl9l\" (UID: \"9eab3ad5-4245-447f-b1c5-a0cc2380d87c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:45.877375 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:45.877352    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg" event={"ID":"4a5b1c77-0e75-4bd1-927c-249c40beeca6","Type":"ContainerStarted","Data":"7e4c908a960515a67608714b043d77e7554a23e4612062ddecd220ebb98f124b"}
Jul 09 17:32:46.011493 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.011462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:46.182189 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.182123    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c99kv"]
Jul 09 17:32:46.185421 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.185406    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:46.187540 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.187519    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:46.189351 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.189329    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5gx2h\""
Jul 09 17:32:46.189644 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.189626    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 17:32:46.201604 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.201585    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c99kv"]
Jul 09 17:32:46.253635 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.253609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp6cj\" (UniqueName: \"kubernetes.io/projected/d065ce89-754a-4bf9-a188-5cecf6597d47-kube-api-access-vp6cj\") pod \"model-serving-api-54d89bd5fc-c99kv\" (UID: \"d065ce89-754a-4bf9-a188-5cecf6597d47\") " pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:46.253726 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.253662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d065ce89-754a-4bf9-a188-5cecf6597d47-tls-certs\") pod \"model-serving-api-54d89bd5fc-c99kv\" (UID: \"d065ce89-754a-4bf9-a188-5cecf6597d47\") " pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:46.253726 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.253690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eab3ad5-4245-447f-b1c5-a0cc2380d87c-cert\") pod \"odh-model-controller-7998c67dc4-rxl9l\" (UID: \"9eab3ad5-4245-447f-b1c5-a0cc2380d87c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:46.256042 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.256016    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9eab3ad5-4245-447f-b1c5-a0cc2380d87c-cert\") pod \"odh-model-controller-7998c67dc4-rxl9l\" (UID: \"9eab3ad5-4245-447f-b1c5-a0cc2380d87c\") " pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:46.354245 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.354184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6cj\" (UniqueName: \"kubernetes.io/projected/d065ce89-754a-4bf9-a188-5cecf6597d47-kube-api-access-vp6cj\") pod \"model-serving-api-54d89bd5fc-c99kv\" (UID: \"d065ce89-754a-4bf9-a188-5cecf6597d47\") " pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:46.354357 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.354286    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d065ce89-754a-4bf9-a188-5cecf6597d47-tls-certs\") pod \"model-serving-api-54d89bd5fc-c99kv\" (UID: \"d065ce89-754a-4bf9-a188-5cecf6597d47\") " pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:46.354508 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:32:46.354436    2583 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 09 17:32:46.354607 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:32:46.354562    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d065ce89-754a-4bf9-a188-5cecf6597d47-tls-certs podName:d065ce89-754a-4bf9-a188-5cecf6597d47 nodeName:}" failed. No retries permitted until 2026-07-09 17:32:46.85454716 +0000 UTC m=+290.637266468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d065ce89-754a-4bf9-a188-5cecf6597d47-tls-certs") pod "model-serving-api-54d89bd5fc-c99kv" (UID: "d065ce89-754a-4bf9-a188-5cecf6597d47") : secret "model-serving-api-tls" not found
Jul 09 17:32:46.370799 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.370773    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6cj\" (UniqueName: \"kubernetes.io/projected/d065ce89-754a-4bf9-a188-5cecf6597d47-kube-api-access-vp6cj\") pod \"model-serving-api-54d89bd5fc-c99kv\" (UID: \"d065ce89-754a-4bf9-a188-5cecf6597d47\") " pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:46.462929 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.462853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:46.513881 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.513856    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:46.624520 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.624495    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"]
Jul 09 17:32:46.628759 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.628732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:46.629775 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.629216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.633398 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.633374    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 17:32:46.633488 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.633415    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 17:32:46.633718 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.633701    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 17:32:46.633782 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.633770    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j9zt2\""
Jul 09 17:32:46.633839 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.633813    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 17:32:46.642722 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.642528    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"]
Jul 09 17:32:46.655690 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.655653    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-cacerts\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.655793 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.655719    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.655793 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.655772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.655902 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.655817    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.655902 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.655853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-local-certs\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.656010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.655911    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-token\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.656010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.655945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m67v4\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-kube-api-access-m67v4\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.669010 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:32:46.668988    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eab3ad5_4245_447f_b1c5_a0cc2380d87c.slice/crio-8ab78e730768251401e85d40731e1ae3aa56fe7a597d2a05f29d299f06c7f65a WatchSource:0}: Error finding container 8ab78e730768251401e85d40731e1ae3aa56fe7a597d2a05f29d299f06c7f65a: Status 404 returned error can't find the container with id 8ab78e730768251401e85d40731e1ae3aa56fe7a597d2a05f29d299f06c7f65a
Jul 09 17:32:46.673181 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.673159    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rxl9l"]
Jul 09 17:32:46.695790 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.695759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:46.756940 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.756890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.756940 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.756927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.757086 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.756947    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-local-certs\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.757086 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.757002    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-token\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.757086 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.757040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m67v4\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-kube-api-access-m67v4\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.757280 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.757094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-cacerts\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.757280 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.757162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.757556 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.757536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.759133 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.759105    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-local-certs\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.759432 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.759412    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.759498 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.759443    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-cacerts\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.759498 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.759492    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.764432 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.764414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-token\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.764753 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.764735    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m67v4\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-kube-api-access-m67v4\") pod \"istiod-openshift-gateway-7574459656-7tjqz\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:46.857846 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.857818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d065ce89-754a-4bf9-a188-5cecf6597d47-tls-certs\") pod \"model-serving-api-54d89bd5fc-c99kv\" (UID: \"d065ce89-754a-4bf9-a188-5cecf6597d47\") " pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:46.860158 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.860140    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d065ce89-754a-4bf9-a188-5cecf6597d47-tls-certs\") pod \"model-serving-api-54d89bd5fc-c99kv\" (UID: \"d065ce89-754a-4bf9-a188-5cecf6597d47\") " pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:46.883467 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.883441    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l" event={"ID":"9eab3ad5-4245-447f-b1c5-a0cc2380d87c","Type":"ContainerStarted","Data":"8ab78e730768251401e85d40731e1ae3aa56fe7a597d2a05f29d299f06c7f65a"}
Jul 09 17:32:46.944014 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:46.943995    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:47.080031 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:47.080008    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"]
Jul 09 17:32:47.081802 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:32:47.081775    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabff13b1_1b3e_441e_ad0e_ba81fed0d1a7.slice/crio-01b0c712a6b9638b17fdb4ab3a8516db49258c9865c356fbb0ddc615e9a00d8b WatchSource:0}: Error finding container 01b0c712a6b9638b17fdb4ab3a8516db49258c9865c356fbb0ddc615e9a00d8b: Status 404 returned error can't find the container with id 01b0c712a6b9638b17fdb4ab3a8516db49258c9865c356fbb0ddc615e9a00d8b
Jul 09 17:32:47.096109 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:47.096091    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:47.236269 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:47.236242    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c99kv"]
Jul 09 17:32:47.238023 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:32:47.237999    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd065ce89_754a_4bf9_a188_5cecf6597d47.slice/crio-20c678925cfeacf2f203ed85ccbf027cd0e78526460744fe960aa4c13fc069ec WatchSource:0}: Error finding container 20c678925cfeacf2f203ed85ccbf027cd0e78526460744fe960aa4c13fc069ec: Status 404 returned error can't find the container with id 20c678925cfeacf2f203ed85ccbf027cd0e78526460744fe960aa4c13fc069ec
Jul 09 17:32:47.567719 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:47.567684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:47.892159 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:47.892119    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c99kv" event={"ID":"d065ce89-754a-4bf9-a188-5cecf6597d47","Type":"ContainerStarted","Data":"20c678925cfeacf2f203ed85ccbf027cd0e78526460744fe960aa4c13fc069ec"}
Jul 09 17:32:47.894493 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:47.894220    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz" event={"ID":"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7","Type":"ContainerStarted","Data":"01b0c712a6b9638b17fdb4ab3a8516db49258c9865c356fbb0ddc615e9a00d8b"}
Jul 09 17:32:50.196812 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:50.196758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:51.698042 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.698003    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:32:51.698406 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.698070    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 17:32:51.915308 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.915268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l" event={"ID":"9eab3ad5-4245-447f-b1c5-a0cc2380d87c","Type":"ContainerStarted","Data":"1f3a2fd42e46eb88d2e6bc0fc78355cd2f48a564c084e628a457f1c62852cdad"}
Jul 09 17:32:51.915492 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.915433    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:32:51.916960 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.916936    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c99kv" event={"ID":"d065ce89-754a-4bf9-a188-5cecf6597d47","Type":"ContainerStarted","Data":"ae80f61080e87078324979e9be344991d4d819de3611fba1a6f1a164e0308054"}
Jul 09 17:32:51.917070 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.916984    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:32:51.918602 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.918530    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg" event={"ID":"4a5b1c77-0e75-4bd1-927c-249c40beeca6","Type":"ContainerStarted","Data":"581e3447d437fbea70b098fa2d56fa5aced731fc5930d90c170c0945bbe40bd1"}
Jul 09 17:32:51.920012 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.919992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz" event={"ID":"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7","Type":"ContainerStarted","Data":"40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970"}
Jul 09 17:32:51.920111 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.920099    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:51.931093 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.931052    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l" podStartSLOduration=1.904799414 podStartE2EDuration="6.931040235s" totalImagesPullingTime="5.026240821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:51.930476146 +0000 UTC m=+295.713195479" watchObservedRunningTime="2026-07-09 17:32:51.931040235 +0000 UTC m=+295.713759566"
Jul 09 17:32:51.946287 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.946249    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-c99kv" podStartSLOduration=1.488442831 podStartE2EDuration="5.946238159s" totalImagesPullingTime="4.457795328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:51.945930932 +0000 UTC m=+295.728650263" watchObservedRunningTime="2026-07-09 17:32:51.946238159 +0000 UTC m=+295.728957490"
Jul 09 17:32:51.963578 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.963538    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-zgzdg" podStartSLOduration=0.928829428 podStartE2EDuration="6.963527002s" totalImagesPullingTime="6.034697574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:51.963513885 +0000 UTC m=+295.746233217" watchObservedRunningTime="2026-07-09 17:32:51.963527002 +0000 UTC m=+295.746246332"
Jul 09 17:32:51.981826 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:51.981788    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz" podStartSLOduration=1.367782015 podStartE2EDuration="5.981776618s" totalImagesPullingTime="4.613994603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:51.981025183 +0000 UTC m=+295.763744513" watchObservedRunningTime="2026-07-09 17:32:51.981776618 +0000 UTC m=+295.764495949"
Jul 09 17:32:52.773465 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:52.773434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:52.904891 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:52.904845    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:52.926268 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:52.926243    2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-7tjqz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 17:32:52.926374 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:52.926301    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz" podUID="abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 17:32:53.343265 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:53.343231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:53.544352 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:53.544309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:53.653054 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:53.652976    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:55.917087 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.917058    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"]
Jul 09 17:32:55.920426 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.920409    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:55.925315 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.925292    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:55.925850 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.925828    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 17:32:55.925949 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.925879    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 17:32:55.927382 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.927360    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2d9k8\""
Jul 09 17:32:55.927484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.927429    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 17:32:55.927484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.927432    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 17:32:55.927610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.927432    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 17:32:55.944369 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:55.944345    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"]
Jul 09 17:32:56.038091 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.038071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3132994-1f76-4c94-b165-8f55ddb421a9-manager-config\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.038229 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.038098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3132994-1f76-4c94-b165-8f55ddb421a9-metrics-cert\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.038304 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.038221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp74d\" (UniqueName: \"kubernetes.io/projected/b3132994-1f76-4c94-b165-8f55ddb421a9-kube-api-access-xp74d\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.038304 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.038270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3132994-1f76-4c94-b165-8f55ddb421a9-cert\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.115105 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.115071    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:56.138845 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.138821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3132994-1f76-4c94-b165-8f55ddb421a9-manager-config\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.138997 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.138860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3132994-1f76-4c94-b165-8f55ddb421a9-metrics-cert\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.138997 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.138904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp74d\" (UniqueName: \"kubernetes.io/projected/b3132994-1f76-4c94-b165-8f55ddb421a9-kube-api-access-xp74d\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.138997 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.138932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3132994-1f76-4c94-b165-8f55ddb421a9-cert\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.139604 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.139579    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3132994-1f76-4c94-b165-8f55ddb421a9-manager-config\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.141401 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.141374    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3132994-1f76-4c94-b165-8f55ddb421a9-metrics-cert\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.141610 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.141587    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3132994-1f76-4c94-b165-8f55ddb421a9-cert\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.150010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.149981    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp74d\" (UniqueName: \"kubernetes.io/projected/b3132994-1f76-4c94-b165-8f55ddb421a9-kube-api-access-xp74d\") pod \"lws-controller-manager-6784c458c5-s8pqs\" (UID: \"b3132994-1f76-4c94-b165-8f55ddb421a9\") " pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.196909 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.196847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:56.229912 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.229890    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:56.356952 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.356926    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"]
Jul 09 17:32:56.358669 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:32:56.358645    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3132994_1f76_4c94_b165_8f55ddb421a9.slice/crio-5837588ac16e973a6debbc564745a1fb85da8abb5bf5ca128d20834119a5af05 WatchSource:0}: Error finding container 5837588ac16e973a6debbc564745a1fb85da8abb5bf5ca128d20834119a5af05: Status 404 returned error can't find the container with id 5837588ac16e973a6debbc564745a1fb85da8abb5bf5ca128d20834119a5af05
Jul 09 17:32:56.403686 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.403662    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:56.524856 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.524780    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:32:56.526550 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.526530    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:32:56.530009 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.529992    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 17:32:56.540286 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.540254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:56.639378 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.639346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:32:56.943183 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:56.943157    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs" event={"ID":"b3132994-1f76-4c94-b165-8f55ddb421a9","Type":"ContainerStarted","Data":"5837588ac16e973a6debbc564745a1fb85da8abb5bf5ca128d20834119a5af05"}
Jul 09 17:32:58.952850 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:58.952814    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs" event={"ID":"b3132994-1f76-4c94-b165-8f55ddb421a9","Type":"ContainerStarted","Data":"2aeb3d183cc808322d0c87ffb6f5ec0661fccc7c49a716a769250f3e7d378669"}
Jul 09 17:32:58.953257 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:58.952884    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:32:58.975496 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:58.975448    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs" podStartSLOduration=2.355062589 podStartE2EDuration="3.975430654s" totalImagesPullingTime="1.620368065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:58.973921416 +0000 UTC m=+302.756640748" watchObservedRunningTime="2026-07-09 17:32:58.975430654 +0000 UTC m=+302.758150068"
Jul 09 17:32:59.215512 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.215443    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"]
Jul 09 17:32:59.215647 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.215612    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz" podUID="abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" containerName="discovery" containerID="cri-o://40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970" gracePeriod=30
Jul 09 17:32:59.473849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.473793    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:59.564837 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.564792    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-kubeconfig\") pod \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") "
Jul 09 17:32:59.565010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.564856    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-cacerts\") pod \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") "
Jul 09 17:32:59.565010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.564899    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-ca-configmap\") pod \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") "
Jul 09 17:32:59.565010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.564926    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-dns-cert\") pod \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") "
Jul 09 17:32:59.565010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.564951    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-token\") pod \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") "
Jul 09 17:32:59.565010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.564978    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-local-certs\") pod \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") "
Jul 09 17:32:59.565010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.565001    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m67v4\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-kube-api-access-m67v4\") pod \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\" (UID: \"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7\") "
Jul 09 17:32:59.565385 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.565345    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" (UID: "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:32:59.567240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.567191    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-cacerts" (OuterVolumeSpecName: "cacerts") pod "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" (UID: "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:32:59.567240 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.567222    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" (UID: "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:32:59.567464 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.567445    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-local-certs" (OuterVolumeSpecName: "local-certs") pod "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" (UID: "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:32:59.567759 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.567741    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" (UID: "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:32:59.567808 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.567740    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" (UID: "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:32:59.567808 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.567769    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-kube-api-access-m67v4" (OuterVolumeSpecName: "kube-api-access-m67v4") pod "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" (UID: "abff13b1-1b3e-441e-ad0e-ba81fed0d1a7"). InnerVolumeSpecName "kube-api-access-m67v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:32:59.665782 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.665755    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-token\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:59.665782 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.665778    2583 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-local-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:59.665782 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.665786    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m67v4\" (UniqueName: \"kubernetes.io/projected/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-kube-api-access-m67v4\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:59.665990 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.665795    2583 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-kubeconfig\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:59.665990 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.665803    2583 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-cacerts\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:59.665990 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.665810    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-ca-configmap\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:59.665990 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.665818    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7-istio-csr-dns-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:32:59.958089 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.958060    2583 generic.go:356] "Generic (PLEG): container finished" podID="abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" containerID="40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970" exitCode=0
Jul 09 17:32:59.958484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.958099    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"
Jul 09 17:32:59.958484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.958150    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz" event={"ID":"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7","Type":"ContainerDied","Data":"40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970"}
Jul 09 17:32:59.958484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.958212    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz" event={"ID":"abff13b1-1b3e-441e-ad0e-ba81fed0d1a7","Type":"ContainerDied","Data":"01b0c712a6b9638b17fdb4ab3a8516db49258c9865c356fbb0ddc615e9a00d8b"}
Jul 09 17:32:59.958484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.958239    2583 scope.go:117] "RemoveContainer" containerID="40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970"
Jul 09 17:32:59.966639 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.966625    2583 scope.go:117] "RemoveContainer" containerID="40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970"
Jul 09 17:32:59.966881 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:32:59.966864    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970\": container with ID starting with 40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970 not found: ID does not exist" containerID="40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970"
Jul 09 17:32:59.966947 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.966887    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970"} err="failed to get container status \"40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970\": rpc error: code = NotFound desc = could not find container \"40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970\": container with ID starting with 40866d9645df02ee133c9f521777a99d3c4ead7a3ec86f1f9da097c3d3412970 not found: ID does not exist"
Jul 09 17:32:59.981072 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.981053    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"]
Jul 09 17:32:59.991926 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:32:59.991903    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7tjqz"]
Jul 09 17:33:00.669397 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:33:00.669370    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" path="/var/lib/kubelet/pods/abff13b1-1b3e-441e-ad0e-ba81fed0d1a7/volumes"
Jul 09 17:33:02.926828 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:33:02.926802    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rxl9l"
Jul 09 17:33:02.928952 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:33:02.928922    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-c99kv"
Jul 09 17:33:09.960893 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:33:09.960859    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6784c458c5-s8pqs"
Jul 09 17:33:46.460668 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:33:46.460634    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:46.576304 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:33:46.576272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:46.689907 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:33:46.689865    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:47.384020 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:33:47.383982    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:33:47.613444 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:33:47.613410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:02.367398 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.367369    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"]
Jul 09 17:34:02.367763 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.367668    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" containerName="discovery"
Jul 09 17:34:02.367763 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.367680    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" containerName="discovery"
Jul 09 17:34:02.367763 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.367731    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="abff13b1-1b3e-441e-ad0e-ba81fed0d1a7" containerName="discovery"
Jul 09 17:34:02.371912 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.371894    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.374781 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.374761    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8qdz7\""
Jul 09 17:34:02.374904 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.374804    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 17:34:02.374904 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.374772    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 17:34:02.378280 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.378258    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"]
Jul 09 17:34:02.420510 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.420488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.420634 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.420568    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.420634 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.420621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jskps\" (UniqueName: \"kubernetes.io/projected/1516a191-a298-4f57-a233-9e6617d9e684-kube-api-access-jskps\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.521342 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.521317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.521450 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.521356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jskps\" (UniqueName: \"kubernetes.io/projected/1516a191-a298-4f57-a233-9e6617d9e684-kube-api-access-jskps\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.521450 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.521395    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.521652 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.521633    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.521700 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.521677    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.529259 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.529238    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jskps\" (UniqueName: \"kubernetes.io/projected/1516a191-a298-4f57-a233-9e6617d9e684-kube-api-access-jskps\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.681496 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.681428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:02.804379 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.804316    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"]
Jul 09 17:34:02.806572 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:34:02.806547    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1516a191_a298_4f57_a233_9e6617d9e684.slice/crio-cab369e369f8be4161c111378e97f927909cbabdf0dabf9cea8fe72b1bc85d81 WatchSource:0}: Error finding container cab369e369f8be4161c111378e97f927909cbabdf0dabf9cea8fe72b1bc85d81: Status 404 returned error can't find the container with id cab369e369f8be4161c111378e97f927909cbabdf0dabf9cea8fe72b1bc85d81
Jul 09 17:34:02.968676 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.968609    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"]
Jul 09 17:34:02.971916 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.971899    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:02.979564 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:02.979535    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"]
Jul 09 17:34:03.025318 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.025285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.025484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.025332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk44d\" (UniqueName: \"kubernetes.io/projected/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-kube-api-access-gk44d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.025484 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.025369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.126651 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.126618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.126829 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.126676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk44d\" (UniqueName: \"kubernetes.io/projected/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-kube-api-access-gk44d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.126829 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.126730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.126978 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.126957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.127075 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.127057    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.134979 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.134954    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk44d\" (UniqueName: \"kubernetes.io/projected/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-kube-api-access-gk44d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.241615 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.241535    2583 generic.go:356] "Generic (PLEG): container finished" podID="1516a191-a298-4f57-a233-9e6617d9e684" containerID="bf4a1b5e771924e5566aee5f6dc9d847057487f0dcea7c98345fc69e4cc894e4" exitCode=0
Jul 09 17:34:03.241732 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.241617    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x" event={"ID":"1516a191-a298-4f57-a233-9e6617d9e684","Type":"ContainerDied","Data":"bf4a1b5e771924e5566aee5f6dc9d847057487f0dcea7c98345fc69e4cc894e4"}
Jul 09 17:34:03.241732 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.241687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x" event={"ID":"1516a191-a298-4f57-a233-9e6617d9e684","Type":"ContainerStarted","Data":"cab369e369f8be4161c111378e97f927909cbabdf0dabf9cea8fe72b1bc85d81"}
Jul 09 17:34:03.242000 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.241985    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:34:03.282184 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.282159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:03.404968 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.404937    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"]
Jul 09 17:34:03.409781 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:34:03.409758    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5e89a1_27bb_4a9b_8a9b_13c316b88a41.slice/crio-30126a4379993d7e29501f88db7f877c0dbf72d045134dd34092151f11becf9e WatchSource:0}: Error finding container 30126a4379993d7e29501f88db7f877c0dbf72d045134dd34092151f11becf9e: Status 404 returned error can't find the container with id 30126a4379993d7e29501f88db7f877c0dbf72d045134dd34092151f11becf9e
Jul 09 17:34:03.570304 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.570273    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"]
Jul 09 17:34:03.573557 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.573538    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.581513 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.581489    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"]
Jul 09 17:34:03.631425 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.631398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.631425 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.631429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.631611 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.631461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5n8f\" (UniqueName: \"kubernetes.io/projected/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-kube-api-access-m5n8f\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.732543 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.732510    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.732543 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.732546    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.732737 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.732583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5n8f\" (UniqueName: \"kubernetes.io/projected/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-kube-api-access-m5n8f\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.732968 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.732949    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.733032 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.732952    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.740794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.740772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5n8f\" (UniqueName: \"kubernetes.io/projected/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-kube-api-access-m5n8f\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:03.883214 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:03.883172    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:04.016215 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.016173    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"]
Jul 09 17:34:04.028062 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:34:04.028039    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c9f4ce_ecc2_4a27_828f_82fbbf02b4b2.slice/crio-0e085b942485cb96681200dcaac2f914df2cf3689c3def6ac65da3883f7ed866 WatchSource:0}: Error finding container 0e085b942485cb96681200dcaac2f914df2cf3689c3def6ac65da3883f7ed866: Status 404 returned error can't find the container with id 0e085b942485cb96681200dcaac2f914df2cf3689c3def6ac65da3883f7ed866
Jul 09 17:34:04.175335 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.175312    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"]
Jul 09 17:34:04.179850 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.179832    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.186774 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.186749    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"]
Jul 09 17:34:04.237303 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.237281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.237426 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.237333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.237426 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.237409    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g48zq\" (UniqueName: \"kubernetes.io/projected/fef2f356-1df5-4cc0-9599-2b3a973beb12-kube-api-access-g48zq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.248075 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.248048    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x" event={"ID":"1516a191-a298-4f57-a233-9e6617d9e684","Type":"ContainerStarted","Data":"0ee01d561aa10743667eec4f4cc6fefcd5f7372aa309dc432c6ee7abbe4c126e"}
Jul 09 17:34:04.249930 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.249907    2583 generic.go:356] "Generic (PLEG): container finished" podID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerID="77dab0a8b6fa2a434baafdcc6551dcfc9bce61d06d7467de35735c9c7f87dcac" exitCode=0
Jul 09 17:34:04.250030 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.249967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5" event={"ID":"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41","Type":"ContainerDied","Data":"77dab0a8b6fa2a434baafdcc6551dcfc9bce61d06d7467de35735c9c7f87dcac"}
Jul 09 17:34:04.250030 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.250014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5" event={"ID":"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41","Type":"ContainerStarted","Data":"30126a4379993d7e29501f88db7f877c0dbf72d045134dd34092151f11becf9e"}
Jul 09 17:34:04.251777 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.251753    2583 generic.go:356] "Generic (PLEG): container finished" podID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerID="98d885753e446ebeadc9fc0a7793ae0da2ed1b84d1de258ea87155ff0b9db3c3" exitCode=0
Jul 09 17:34:04.251993 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.251793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j" event={"ID":"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2","Type":"ContainerDied","Data":"98d885753e446ebeadc9fc0a7793ae0da2ed1b84d1de258ea87155ff0b9db3c3"}
Jul 09 17:34:04.251993 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.251825    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j" event={"ID":"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2","Type":"ContainerStarted","Data":"0e085b942485cb96681200dcaac2f914df2cf3689c3def6ac65da3883f7ed866"}
Jul 09 17:34:04.338159 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.338125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.338345 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.338169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.338345 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.338223    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g48zq\" (UniqueName: \"kubernetes.io/projected/fef2f356-1df5-4cc0-9599-2b3a973beb12-kube-api-access-g48zq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.338587 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.338564    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.338635 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.338581    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.347059 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.347033    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g48zq\" (UniqueName: \"kubernetes.io/projected/fef2f356-1df5-4cc0-9599-2b3a973beb12-kube-api-access-g48zq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.499922 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.499843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:04.623322 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:04.623294    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"]
Jul 09 17:34:04.624622 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:34:04.624595    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef2f356_1df5_4cc0_9599_2b3a973beb12.slice/crio-eb60859e0f9d46172fc783ed0113515357f695f8c20d5c4a72d95d9c7b771070 WatchSource:0}: Error finding container eb60859e0f9d46172fc783ed0113515357f695f8c20d5c4a72d95d9c7b771070: Status 404 returned error can't find the container with id eb60859e0f9d46172fc783ed0113515357f695f8c20d5c4a72d95d9c7b771070
Jul 09 17:34:05.257902 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:05.257824    2583 generic.go:356] "Generic (PLEG): container finished" podID="1516a191-a298-4f57-a233-9e6617d9e684" containerID="0ee01d561aa10743667eec4f4cc6fefcd5f7372aa309dc432c6ee7abbe4c126e" exitCode=0
Jul 09 17:34:05.258033 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:05.257915    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x" event={"ID":"1516a191-a298-4f57-a233-9e6617d9e684","Type":"ContainerDied","Data":"0ee01d561aa10743667eec4f4cc6fefcd5f7372aa309dc432c6ee7abbe4c126e"}
Jul 09 17:34:05.259890 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:05.259869    2583 generic.go:356] "Generic (PLEG): container finished" podID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerID="8002f68ddb8b40496ba3f7f159a98bbf761775a73db7113922ce405d37d87fb7" exitCode=0
Jul 09 17:34:05.259997 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:05.259949    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5" event={"ID":"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41","Type":"ContainerDied","Data":"8002f68ddb8b40496ba3f7f159a98bbf761775a73db7113922ce405d37d87fb7"}
Jul 09 17:34:05.261770 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:05.261752    2583 generic.go:356] "Generic (PLEG): container finished" podID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerID="ef047017361af4b5a4f99c2d2af99efd30dfa44162c4a915706796e75570fbc6" exitCode=0
Jul 09 17:34:05.261860 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:05.261817    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j" event={"ID":"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2","Type":"ContainerDied","Data":"ef047017361af4b5a4f99c2d2af99efd30dfa44162c4a915706796e75570fbc6"}
Jul 09 17:34:05.263617 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:05.263597    2583 generic.go:356] "Generic (PLEG): container finished" podID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerID="016817c610da6d5c7903f027e22a212475e13b94c69141f702ab1c1617beee04" exitCode=0
Jul 09 17:34:05.263721 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:05.263659    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2" event={"ID":"fef2f356-1df5-4cc0-9599-2b3a973beb12","Type":"ContainerDied","Data":"016817c610da6d5c7903f027e22a212475e13b94c69141f702ab1c1617beee04"}
Jul 09 17:34:05.263721 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:05.263703    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2" event={"ID":"fef2f356-1df5-4cc0-9599-2b3a973beb12","Type":"ContainerStarted","Data":"eb60859e0f9d46172fc783ed0113515357f695f8c20d5c4a72d95d9c7b771070"}
Jul 09 17:34:06.270465 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:06.270439    2583 generic.go:356] "Generic (PLEG): container finished" podID="1516a191-a298-4f57-a233-9e6617d9e684" containerID="34e47dd18aac8f43d2f4c93a6378f2819d1535c4cf1fd3be704b18353dc85b50" exitCode=0
Jul 09 17:34:06.270771 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:06.270495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x" event={"ID":"1516a191-a298-4f57-a233-9e6617d9e684","Type":"ContainerDied","Data":"34e47dd18aac8f43d2f4c93a6378f2819d1535c4cf1fd3be704b18353dc85b50"}
Jul 09 17:34:06.272480 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:06.272460    2583 generic.go:356] "Generic (PLEG): container finished" podID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerID="18da134b50f93f5e73cf7c6cd1e59590a7be4c77445840a71a86f04abdacbcda" exitCode=0
Jul 09 17:34:06.272590 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:06.272544    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5" event={"ID":"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41","Type":"ContainerDied","Data":"18da134b50f93f5e73cf7c6cd1e59590a7be4c77445840a71a86f04abdacbcda"}
Jul 09 17:34:06.280069 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:06.280043    2583 generic.go:356] "Generic (PLEG): container finished" podID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerID="7d045d3ee57a49a19547e16d045b11703af95c4987b820a43bac1fcbf679ae11" exitCode=0
Jul 09 17:34:06.280170 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:06.280093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j" event={"ID":"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2","Type":"ContainerDied","Data":"7d045d3ee57a49a19547e16d045b11703af95c4987b820a43bac1fcbf679ae11"}
Jul 09 17:34:06.281775 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:06.281754    2583 generic.go:356] "Generic (PLEG): container finished" podID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerID="031f09ed450747a3826a8ce475dbc5de2402ba280553f60ed01103a3966514c2" exitCode=0
Jul 09 17:34:06.281849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:06.281784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2" event={"ID":"fef2f356-1df5-4cc0-9599-2b3a973beb12","Type":"ContainerDied","Data":"031f09ed450747a3826a8ce475dbc5de2402ba280553f60ed01103a3966514c2"}
Jul 09 17:34:07.288596 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.288565    2583 generic.go:356] "Generic (PLEG): container finished" podID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerID="2172195226bd5ccccf723244fa05a49c110ca66844331a4acb7aa89638913ca6" exitCode=0
Jul 09 17:34:07.288988 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.288651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2" event={"ID":"fef2f356-1df5-4cc0-9599-2b3a973beb12","Type":"ContainerDied","Data":"2172195226bd5ccccf723244fa05a49c110ca66844331a4acb7aa89638913ca6"}
Jul 09 17:34:07.428331 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.428306    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:07.443943 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.443924    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:07.460271 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.460253    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-bundle\") pod \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") "
Jul 09 17:34:07.460376 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.460319    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-bundle\") pod \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") "
Jul 09 17:34:07.460376 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.460356    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-util\") pod \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") "
Jul 09 17:34:07.460493 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.460426    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk44d\" (UniqueName: \"kubernetes.io/projected/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-kube-api-access-gk44d\") pod \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\" (UID: \"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41\") "
Jul 09 17:34:07.460493 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.460463    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-util\") pod \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") "
Jul 09 17:34:07.460590 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.460490    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5n8f\" (UniqueName: \"kubernetes.io/projected/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-kube-api-access-m5n8f\") pod \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\" (UID: \"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2\") "
Jul 09 17:34:07.461126 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.461073    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-bundle" (OuterVolumeSpecName: "bundle") pod "4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" (UID: "4e5e89a1-27bb-4a9b-8a9b-13c316b88a41"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:34:07.461286 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.461129    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-bundle" (OuterVolumeSpecName: "bundle") pod "18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" (UID: "18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:34:07.462762 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.462737    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-kube-api-access-gk44d" (OuterVolumeSpecName: "kube-api-access-gk44d") pod "4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" (UID: "4e5e89a1-27bb-4a9b-8a9b-13c316b88a41"). InnerVolumeSpecName "kube-api-access-gk44d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:34:07.462975 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.462961    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-kube-api-access-m5n8f" (OuterVolumeSpecName: "kube-api-access-m5n8f") pod "18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" (UID: "18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2"). InnerVolumeSpecName "kube-api-access-m5n8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:34:07.464810 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.464793    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:07.466699 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.466671    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-util" (OuterVolumeSpecName: "util") pod "18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" (UID: "18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:34:07.467700 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.467667    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-util" (OuterVolumeSpecName: "util") pod "4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" (UID: "4e5e89a1-27bb-4a9b-8a9b-13c316b88a41"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:34:07.560979 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.560907    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-bundle\") pod \"1516a191-a298-4f57-a233-9e6617d9e684\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") "
Jul 09 17:34:07.560979 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.560958    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-util\") pod \"1516a191-a298-4f57-a233-9e6617d9e684\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") "
Jul 09 17:34:07.561156 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.560999    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jskps\" (UniqueName: \"kubernetes.io/projected/1516a191-a298-4f57-a233-9e6617d9e684-kube-api-access-jskps\") pod \"1516a191-a298-4f57-a233-9e6617d9e684\" (UID: \"1516a191-a298-4f57-a233-9e6617d9e684\") "
Jul 09 17:34:07.561156 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.561130    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk44d\" (UniqueName: \"kubernetes.io/projected/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-kube-api-access-gk44d\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:07.561156 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.561148    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-util\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:07.561333 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.561162    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5n8f\" (UniqueName: \"kubernetes.io/projected/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-kube-api-access-m5n8f\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:07.561333 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.561178    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:07.561333 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.561190    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:07.561333 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.561219    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e5e89a1-27bb-4a9b-8a9b-13c316b88a41-util\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:07.561505 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.561445    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-bundle" (OuterVolumeSpecName: "bundle") pod "1516a191-a298-4f57-a233-9e6617d9e684" (UID: "1516a191-a298-4f57-a233-9e6617d9e684"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:34:07.563001 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.562982    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1516a191-a298-4f57-a233-9e6617d9e684-kube-api-access-jskps" (OuterVolumeSpecName: "kube-api-access-jskps") pod "1516a191-a298-4f57-a233-9e6617d9e684" (UID: "1516a191-a298-4f57-a233-9e6617d9e684"). InnerVolumeSpecName "kube-api-access-jskps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:34:07.568879 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.568858    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-util" (OuterVolumeSpecName: "util") pod "1516a191-a298-4f57-a233-9e6617d9e684" (UID: "1516a191-a298-4f57-a233-9e6617d9e684"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:34:07.662526 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.662496    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jskps\" (UniqueName: \"kubernetes.io/projected/1516a191-a298-4f57-a233-9e6617d9e684-kube-api-access-jskps\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:07.662526 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.662522    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:07.662526 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:07.662531    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1516a191-a298-4f57-a233-9e6617d9e684-util\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:08.283184 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.283154    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:08.295269 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.295242    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j"
Jul 09 17:34:08.295269 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.295259    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j" event={"ID":"18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2","Type":"ContainerDied","Data":"0e085b942485cb96681200dcaac2f914df2cf3689c3def6ac65da3883f7ed866"}
Jul 09 17:34:08.295690 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.295303    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e085b942485cb96681200dcaac2f914df2cf3689c3def6ac65da3883f7ed866"
Jul 09 17:34:08.297151 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.297132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x" event={"ID":"1516a191-a298-4f57-a233-9e6617d9e684","Type":"ContainerDied","Data":"cab369e369f8be4161c111378e97f927909cbabdf0dabf9cea8fe72b1bc85d81"}
Jul 09 17:34:08.297151 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.297142    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x"
Jul 09 17:34:08.297324 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.297170    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cab369e369f8be4161c111378e97f927909cbabdf0dabf9cea8fe72b1bc85d81"
Jul 09 17:34:08.299040 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.299018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5" event={"ID":"4e5e89a1-27bb-4a9b-8a9b-13c316b88a41","Type":"ContainerDied","Data":"30126a4379993d7e29501f88db7f877c0dbf72d045134dd34092151f11becf9e"}
Jul 09 17:34:08.299127 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.299049    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5"
Jul 09 17:34:08.299127 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.299052    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30126a4379993d7e29501f88db7f877c0dbf72d045134dd34092151f11becf9e"
Jul 09 17:34:08.385504 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.385472    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:08.426397 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.426377    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:08.469045 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.469016    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-bundle\") pod \"fef2f356-1df5-4cc0-9599-2b3a973beb12\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") "
Jul 09 17:34:08.469172 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.469065    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-util\") pod \"fef2f356-1df5-4cc0-9599-2b3a973beb12\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") "
Jul 09 17:34:08.469172 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.469106    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g48zq\" (UniqueName: \"kubernetes.io/projected/fef2f356-1df5-4cc0-9599-2b3a973beb12-kube-api-access-g48zq\") pod \"fef2f356-1df5-4cc0-9599-2b3a973beb12\" (UID: \"fef2f356-1df5-4cc0-9599-2b3a973beb12\") "
Jul 09 17:34:08.469527 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.469500    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-bundle" (OuterVolumeSpecName: "bundle") pod "fef2f356-1df5-4cc0-9599-2b3a973beb12" (UID: "fef2f356-1df5-4cc0-9599-2b3a973beb12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:34:08.471126 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.471094    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fef2f356-1df5-4cc0-9599-2b3a973beb12-kube-api-access-g48zq" (OuterVolumeSpecName: "kube-api-access-g48zq") pod "fef2f356-1df5-4cc0-9599-2b3a973beb12" (UID: "fef2f356-1df5-4cc0-9599-2b3a973beb12"). InnerVolumeSpecName "kube-api-access-g48zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:34:08.474223 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.474190    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-util" (OuterVolumeSpecName: "util") pod "fef2f356-1df5-4cc0-9599-2b3a973beb12" (UID: "fef2f356-1df5-4cc0-9599-2b3a973beb12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:34:08.570605 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.570541    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g48zq\" (UniqueName: \"kubernetes.io/projected/fef2f356-1df5-4cc0-9599-2b3a973beb12-kube-api-access-g48zq\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:08.570605 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.570568    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:08.570605 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:08.570582    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fef2f356-1df5-4cc0-9599-2b3a973beb12-util\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:34:09.306654 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:09.306623    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2"
Jul 09 17:34:09.306654 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:09.306635    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2" event={"ID":"fef2f356-1df5-4cc0-9599-2b3a973beb12","Type":"ContainerDied","Data":"eb60859e0f9d46172fc783ed0113515357f695f8c20d5c4a72d95d9c7b771070"}
Jul 09 17:34:09.307087 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:09.306680    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb60859e0f9d46172fc783ed0113515357f695f8c20d5c4a72d95d9c7b771070"
Jul 09 17:34:10.214510 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:10.214465    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:10.265531 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:10.265502    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:14.675180 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:14.675154    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:20.094649 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:20.094616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:20.681415 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:20.681375    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:21.708702 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:21.708668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:24.354119 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:24.354081    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:24.586937 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:24.586903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:25.050700 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.050671    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-557d78b4cd-dssc9"]
Jul 09 17:34:25.050979 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.050965    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerName="pull"
Jul 09 17:34:25.050979 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.050980    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerName="pull"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.050989    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1516a191-a298-4f57-a233-9e6617d9e684" containerName="util"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.050995    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1516a191-a298-4f57-a233-9e6617d9e684" containerName="util"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051005    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerName="pull"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051011    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerName="pull"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051017    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerName="extract"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051022    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerName="extract"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051029    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerName="pull"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051034    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerName="pull"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051043    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerName="util"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051048    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerName="util"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051055    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerName="extract"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051060    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerName="extract"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051066    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerName="util"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051071    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerName="util"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051078    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1516a191-a298-4f57-a233-9e6617d9e684" containerName="pull"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051083    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1516a191-a298-4f57-a233-9e6617d9e684" containerName="pull"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051096    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerName="util"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051103    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerName="util"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051110    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1516a191-a298-4f57-a233-9e6617d9e684" containerName="extract"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051115    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1516a191-a298-4f57-a233-9e6617d9e684" containerName="extract"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051121    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerName="extract"
Jul 09 17:34:25.051114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051126    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerName="extract"
Jul 09 17:34:25.051922 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051193    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fef2f356-1df5-4cc0-9599-2b3a973beb12" containerName="extract"
Jul 09 17:34:25.051922 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051219    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e5e89a1-27bb-4a9b-8a9b-13c316b88a41" containerName="extract"
Jul 09 17:34:25.051922 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051228    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1516a191-a298-4f57-a233-9e6617d9e684" containerName="extract"
Jul 09 17:34:25.051922 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.051237    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2" containerName="extract"
Jul 09 17:34:25.055902 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.055879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.064479 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.064460    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557d78b4cd-dssc9"]
Jul 09 17:34:25.096815 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.096790    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-oauth-serving-cert\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.096915 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.096826    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5929675a-53ae-4a84-a3c0-8f8c475993b6-console-serving-cert\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.096915 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.096856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-trusted-ca-bundle\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.096915 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.096879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjf5w\" (UniqueName: \"kubernetes.io/projected/5929675a-53ae-4a84-a3c0-8f8c475993b6-kube-api-access-bjf5w\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.096915 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.096901    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5929675a-53ae-4a84-a3c0-8f8c475993b6-console-oauth-config\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.097046 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.096932    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-console-config\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.097046 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.096980    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-service-ca\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.122225 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.122175    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:25.198147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.198123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-trusted-ca-bundle\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.198288 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.198149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjf5w\" (UniqueName: \"kubernetes.io/projected/5929675a-53ae-4a84-a3c0-8f8c475993b6-kube-api-access-bjf5w\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.198288 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.198171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5929675a-53ae-4a84-a3c0-8f8c475993b6-console-oauth-config\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.198288 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.198187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-console-config\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.198461 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.198433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-service-ca\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.198516 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.198479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-oauth-serving-cert\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.198568 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.198518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5929675a-53ae-4a84-a3c0-8f8c475993b6-console-serving-cert\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.199038 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.199015    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-trusted-ca-bundle\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.199038 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.199025    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-console-config\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.199162 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.199140    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-service-ca\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.199226 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.199191    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5929675a-53ae-4a84-a3c0-8f8c475993b6-oauth-serving-cert\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.200606 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.200586    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5929675a-53ae-4a84-a3c0-8f8c475993b6-console-oauth-config\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.200850 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.200834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5929675a-53ae-4a84-a3c0-8f8c475993b6-console-serving-cert\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.205745 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.205725    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjf5w\" (UniqueName: \"kubernetes.io/projected/5929675a-53ae-4a84-a3c0-8f8c475993b6-kube-api-access-bjf5w\") pod \"console-557d78b4cd-dssc9\" (UID: \"5929675a-53ae-4a84-a3c0-8f8c475993b6\") " pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.221834 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.221810    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:25.328635 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.328616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:25.366343 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.366318    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:25.427644 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.427605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:25.495934 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.495912    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557d78b4cd-dssc9"]
Jul 09 17:34:25.497601 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:34:25.497575    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5929675a_53ae_4a84_a3c0_8f8c475993b6.slice/crio-2b4ac83a1117da6388bdbfde8b50d24d3a3a211b0cbca5806bcf33ae27509095 WatchSource:0}: Error finding container 2b4ac83a1117da6388bdbfde8b50d24d3a3a211b0cbca5806bcf33ae27509095: Status 404 returned error can't find the container with id 2b4ac83a1117da6388bdbfde8b50d24d3a3a211b0cbca5806bcf33ae27509095
Jul 09 17:34:25.857139 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.857110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:25.930287 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:25.930260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:26.133178 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:26.133115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:26.386939 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:26.386875    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557d78b4cd-dssc9" event={"ID":"5929675a-53ae-4a84-a3c0-8f8c475993b6","Type":"ContainerStarted","Data":"b25e0486e7892a6caba74bed7187d0dd151e5f7a3f52bf56c95636890931905f"}
Jul 09 17:34:26.386939 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:26.386917    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557d78b4cd-dssc9" event={"ID":"5929675a-53ae-4a84-a3c0-8f8c475993b6","Type":"ContainerStarted","Data":"2b4ac83a1117da6388bdbfde8b50d24d3a3a211b0cbca5806bcf33ae27509095"}
Jul 09 17:34:26.407482 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:26.407423    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-557d78b4cd-dssc9" podStartSLOduration=1.407409607 podStartE2EDuration="1.407409607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:34:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:34:26.406946477 +0000 UTC m=+390.189665809" watchObservedRunningTime="2026-07-09 17:34:26.407409607 +0000 UTC m=+390.190128938"
Jul 09 17:34:27.716995 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:27.716961    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:28.918325 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:28.918278    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:29.322515 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.322435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:29.745555 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.745517    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"]
Jul 09 17:34:29.749028 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.749008    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"
Jul 09 17:34:29.753493 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.753469    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 17:34:29.753596 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.753473    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 17:34:29.754837 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.754820    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 17:34:29.754932 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.754821    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kkkwr\""
Jul 09 17:34:29.764835 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.764809    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"]
Jul 09 17:34:29.777002 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.776979    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"]
Jul 09 17:34:29.780110 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.780094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:29.783152 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.783137    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 17:34:29.783293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.783277    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8qdz7\""
Jul 09 17:34:29.783356 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.783293    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 17:34:29.789422 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.789402    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"]
Jul 09 17:34:29.797442 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.797423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:29.828246 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.828226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slwfn\" (UniqueName: \"kubernetes.io/projected/04e9a411-8b2a-4b84-af42-315712aa4830-kube-api-access-slwfn\") pod \"dns-operator-controller-manager-864dd78c4c-jcdb7\" (UID: \"04e9a411-8b2a-4b84-af42-315712aa4830\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"
Jul 09 17:34:29.828354 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.828266    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpc2q\" (UniqueName: \"kubernetes.io/projected/893929af-f365-4d41-9444-4108e200970f-kube-api-access-vpc2q\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:29.828417 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.828358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/893929af-f365-4d41-9444-4108e200970f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:29.828469 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.828441    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/893929af-f365-4d41-9444-4108e200970f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:29.929018 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.928995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/893929af-f365-4d41-9444-4108e200970f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:29.929386 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.929030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slwfn\" (UniqueName: \"kubernetes.io/projected/04e9a411-8b2a-4b84-af42-315712aa4830-kube-api-access-slwfn\") pod \"dns-operator-controller-manager-864dd78c4c-jcdb7\" (UID: \"04e9a411-8b2a-4b84-af42-315712aa4830\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"
Jul 09 17:34:29.929386 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.929052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpc2q\" (UniqueName: \"kubernetes.io/projected/893929af-f365-4d41-9444-4108e200970f-kube-api-access-vpc2q\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:29.929386 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.929087    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/893929af-f365-4d41-9444-4108e200970f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:29.929386 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:34:29.929166    2583 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 09 17:34:29.929386 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:34:29.929232    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/893929af-f365-4d41-9444-4108e200970f-plugin-serving-cert podName:893929af-f365-4d41-9444-4108e200970f nodeName:}" failed. No retries permitted until 2026-07-09 17:34:30.429217965 +0000 UTC m=+394.211937274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/893929af-f365-4d41-9444-4108e200970f-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-cjp9x" (UID: "893929af-f365-4d41-9444-4108e200970f") : secret "plugin-serving-cert" not found
Jul 09 17:34:29.929760 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.929739    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/893929af-f365-4d41-9444-4108e200970f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:29.945850 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.945825    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slwfn\" (UniqueName: \"kubernetes.io/projected/04e9a411-8b2a-4b84-af42-315712aa4830-kube-api-access-slwfn\") pod \"dns-operator-controller-manager-864dd78c4c-jcdb7\" (UID: \"04e9a411-8b2a-4b84-af42-315712aa4830\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"
Jul 09 17:34:29.946112 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:29.946097    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpc2q\" (UniqueName: \"kubernetes.io/projected/893929af-f365-4d41-9444-4108e200970f-kube-api-access-vpc2q\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:30.033128 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:30.033041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:30.058899 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:30.058867    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"
Jul 09 17:34:30.192303 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:30.192280    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"]
Jul 09 17:34:30.194008 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:34:30.193986    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e9a411_8b2a_4b84_af42_315712aa4830.slice/crio-aca2ea2c0c7d415adfc51da462ed9d8e3b3412b247074779c15b33f25d63bd6b WatchSource:0}: Error finding container aca2ea2c0c7d415adfc51da462ed9d8e3b3412b247074779c15b33f25d63bd6b: Status 404 returned error can't find the container with id aca2ea2c0c7d415adfc51da462ed9d8e3b3412b247074779c15b33f25d63bd6b
Jul 09 17:34:30.409075 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:30.409043    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7" event={"ID":"04e9a411-8b2a-4b84-af42-315712aa4830","Type":"ContainerStarted","Data":"aca2ea2c0c7d415adfc51da462ed9d8e3b3412b247074779c15b33f25d63bd6b"}
Jul 09 17:34:30.434393 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:30.434367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/893929af-f365-4d41-9444-4108e200970f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:30.436701 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:30.436675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/893929af-f365-4d41-9444-4108e200970f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cjp9x\" (UID: \"893929af-f365-4d41-9444-4108e200970f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:30.689755 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:30.689681    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"
Jul 09 17:34:30.834529 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:30.834497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x"]
Jul 09 17:34:30.877262 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:34:30.877231    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod893929af_f365_4d41_9444_4108e200970f.slice/crio-b0c6450a340a00b1ea1bf4872616c00022ea06082391d6f5deca14f74c02058d WatchSource:0}: Error finding container b0c6450a340a00b1ea1bf4872616c00022ea06082391d6f5deca14f74c02058d: Status 404 returned error can't find the container with id b0c6450a340a00b1ea1bf4872616c00022ea06082391d6f5deca14f74c02058d
Jul 09 17:34:31.417142 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:31.417111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x" event={"ID":"893929af-f365-4d41-9444-4108e200970f","Type":"ContainerStarted","Data":"b0c6450a340a00b1ea1bf4872616c00022ea06082391d6f5deca14f74c02058d"}
Jul 09 17:34:31.886986 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:31.886923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:31.986248 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:31.986172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:33.432608 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:33.432561    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7" event={"ID":"04e9a411-8b2a-4b84-af42-315712aa4830","Type":"ContainerStarted","Data":"033d0bbfd335e99f7341b1a8f62d2050b42b1fd931f361d9878feefa7ff5829f"}
Jul 09 17:34:33.433037 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:33.432773    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"
Jul 09 17:34:33.451668 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:33.451616    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7" podStartSLOduration=1.8031123679999999 podStartE2EDuration="4.451603396s" totalImagesPullingTime="2.648491028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:34:33.450735759 +0000 UTC m=+397.233455090" watchObservedRunningTime="2026-07-09 17:34:33.451603396 +0000 UTC m=+397.234322741"
Jul 09 17:34:35.366874 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:35.366834    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:35.367335 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:35.366913    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:35.373104 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:35.373068    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:35.448886 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:35.448857    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-557d78b4cd-dssc9"
Jul 09 17:34:35.499091 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:35.499061    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ddc7b99d-4p6jh"]
Jul 09 17:34:35.612267 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:35.612112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:35.712939 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:35.712860    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:35.813772 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:35.813739    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:41.911794 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:41.911754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:41.982496 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:41.982419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:43.340035 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:43.339981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:44.439703 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:44.439662    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcdb7"
Jul 09 17:34:44.916466 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:44.916431    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:45.018746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:45.018705    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:47.342292 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:47.342257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:47.441986 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:47.441936    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:53.138720 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:53.138686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:53.265261 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:53.265225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:34:54.545850 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:54.545776    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x" event={"ID":"893929af-f365-4d41-9444-4108e200970f","Type":"ContainerStarted","Data":"e3614028c78a28854e81da58860108b67f2c9fe361747a9b105ff8c9257f2648"}
Jul 09 17:34:54.564913 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:34:54.564872    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cjp9x" podStartSLOduration=2.23548032 podStartE2EDuration="25.564858338s" totalImagesPullingTime="23.329378018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:34:54.563313809 +0000 UTC m=+418.346033141" watchObservedRunningTime="2026-07-09 17:34:54.564858338 +0000 UTC m=+418.347577669"
Jul 09 17:35:00.530144 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.530100    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84ddc7b99d-4p6jh" podUID="9f406f34-5146-4fa3-9efa-a3611af74c4f" containerName="console" containerID="cri-o://bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0" gracePeriod=15
Jul 09 17:35:00.772790 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.772762    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:35:00.800722 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.800638    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-serving-cert\") pod \"9f406f34-5146-4fa3-9efa-a3611af74c4f\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") "
Jul 09 17:35:00.800971 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.800715    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n6vt\" (UniqueName: \"kubernetes.io/projected/9f406f34-5146-4fa3-9efa-a3611af74c4f-kube-api-access-9n6vt\") pod \"9f406f34-5146-4fa3-9efa-a3611af74c4f\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") "
Jul 09 17:35:00.801248 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.801223    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-service-ca\") pod \"9f406f34-5146-4fa3-9efa-a3611af74c4f\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") "
Jul 09 17:35:00.801439 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.801413    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-oauth-serving-cert\") pod \"9f406f34-5146-4fa3-9efa-a3611af74c4f\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") "
Jul 09 17:35:00.801546 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.801527    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-service-ca" (OuterVolumeSpecName: "service-ca") pod "9f406f34-5146-4fa3-9efa-a3611af74c4f" (UID: "9f406f34-5146-4fa3-9efa-a3611af74c4f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:35:00.801694 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.801581    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-trusted-ca-bundle\") pod \"9f406f34-5146-4fa3-9efa-a3611af74c4f\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") "
Jul 09 17:35:00.801871 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.801848    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-config\") pod \"9f406f34-5146-4fa3-9efa-a3611af74c4f\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") "
Jul 09 17:35:00.801958 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.801927    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-oauth-config\") pod \"9f406f34-5146-4fa3-9efa-a3611af74c4f\" (UID: \"9f406f34-5146-4fa3-9efa-a3611af74c4f\") "
Jul 09 17:35:00.802175 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.801733    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9f406f34-5146-4fa3-9efa-a3611af74c4f" (UID: "9f406f34-5146-4fa3-9efa-a3611af74c4f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:35:00.802175 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.801961    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9f406f34-5146-4fa3-9efa-a3611af74c4f" (UID: "9f406f34-5146-4fa3-9efa-a3611af74c4f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:35:00.802175 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.802132    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-config" (OuterVolumeSpecName: "console-config") pod "9f406f34-5146-4fa3-9efa-a3611af74c4f" (UID: "9f406f34-5146-4fa3-9efa-a3611af74c4f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 17:35:00.802364 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.802147    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-service-ca\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:00.803577 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.803511    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9f406f34-5146-4fa3-9efa-a3611af74c4f" (UID: "9f406f34-5146-4fa3-9efa-a3611af74c4f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:35:00.803693 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.803662    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f406f34-5146-4fa3-9efa-a3611af74c4f-kube-api-access-9n6vt" (OuterVolumeSpecName: "kube-api-access-9n6vt") pod "9f406f34-5146-4fa3-9efa-a3611af74c4f" (UID: "9f406f34-5146-4fa3-9efa-a3611af74c4f"). InnerVolumeSpecName "kube-api-access-9n6vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:35:00.803848 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.803823    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9f406f34-5146-4fa3-9efa-a3611af74c4f" (UID: "9f406f34-5146-4fa3-9efa-a3611af74c4f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:35:00.903175 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.903149    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-oauth-serving-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:00.903175 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.903171    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-trusted-ca-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:00.903334 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.903181    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:00.903334 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.903190    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-oauth-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:00.903334 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.903216    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f406f34-5146-4fa3-9efa-a3611af74c4f-console-serving-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:00.903334 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:00.903224    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n6vt\" (UniqueName: \"kubernetes.io/projected/9f406f34-5146-4fa3-9efa-a3611af74c4f-kube-api-access-9n6vt\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:01.581233 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:01.581182    2583 generic.go:356] "Generic (PLEG): container finished" podID="9f406f34-5146-4fa3-9efa-a3611af74c4f" containerID="bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0" exitCode=0
Jul 09 17:35:01.581630 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:01.581254    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84ddc7b99d-4p6jh"
Jul 09 17:35:01.581630 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:01.581272    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ddc7b99d-4p6jh" event={"ID":"9f406f34-5146-4fa3-9efa-a3611af74c4f","Type":"ContainerDied","Data":"bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0"}
Jul 09 17:35:01.581630 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:01.581349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84ddc7b99d-4p6jh" event={"ID":"9f406f34-5146-4fa3-9efa-a3611af74c4f","Type":"ContainerDied","Data":"12e416ac74c7d75e6b1b2cf8ad715da332c22bb2046380b2915ac57ec3358250"}
Jul 09 17:35:01.581630 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:01.581371    2583 scope.go:117] "RemoveContainer" containerID="bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0"
Jul 09 17:35:01.590423 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:01.590407    2583 scope.go:117] "RemoveContainer" containerID="bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0"
Jul 09 17:35:01.590685 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:35:01.590666    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0\": container with ID starting with bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0 not found: ID does not exist" containerID="bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0"
Jul 09 17:35:01.590750 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:01.590694    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0"} err="failed to get container status \"bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0\": rpc error: code = NotFound desc = could not find container \"bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0\": container with ID starting with bed940a5e19a72ce2342e75a4d8673d8831e6844a485751f0f9b4201f61ab4b0 not found: ID does not exist"
Jul 09 17:35:01.604329 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:01.604306    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84ddc7b99d-4p6jh"]
Jul 09 17:35:01.606186 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:01.606170    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84ddc7b99d-4p6jh"]
Jul 09 17:35:02.669692 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:02.669661    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f406f34-5146-4fa3-9efa-a3611af74c4f" path="/var/lib/kubelet/pods/9f406f34-5146-4fa3-9efa-a3611af74c4f/volumes"
Jul 09 17:35:03.302749 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:03.302722    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:03.402828 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:03.402796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:03.502334 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:03.502304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:03.567044 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:03.566974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:05.314036 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:05.314007    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:05.415285 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:05.415250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:07.769276 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:07.769237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:08.164132 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:08.164080    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:09.153782 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:09.153747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:09.348970 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:09.348943    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:10.879113 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:10.879081    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:10.982154 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:10.982116    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:11.056145 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.056114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:11.671327 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.671299    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rsw2q"]
Jul 09 17:35:11.671612 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.671599    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f406f34-5146-4fa3-9efa-a3611af74c4f" containerName="console"
Jul 09 17:35:11.671659 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.671613    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f406f34-5146-4fa3-9efa-a3611af74c4f" containerName="console"
Jul 09 17:35:11.671697 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.671670    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f406f34-5146-4fa3-9efa-a3611af74c4f" containerName="console"
Jul 09 17:35:11.674848 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.674830    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rsw2q"
Jul 09 17:35:11.677660 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.677633    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9rhx2\""
Jul 09 17:35:11.682141 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.682112    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsw2q"]
Jul 09 17:35:11.702169 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.702137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:11.778442 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.778418    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:11.785395 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.785371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcw85\" (UniqueName: \"kubernetes.io/projected/01b18027-8227-448e-bcd0-1e5ec5fc5a92-kube-api-access-fcw85\") pod \"authorino-58cd955675-rsw2q\" (UID: \"01b18027-8227-448e-bcd0-1e5ec5fc5a92\") " pod="kuadrant-system/authorino-58cd955675-rsw2q"
Jul 09 17:35:11.842738 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.842704    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zhkf2"]
Jul 09 17:35:11.845969 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.845952    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zhkf2"
Jul 09 17:35:11.851333 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.851309    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zhkf2"]
Jul 09 17:35:11.886701 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.886680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcw85\" (UniqueName: \"kubernetes.io/projected/01b18027-8227-448e-bcd0-1e5ec5fc5a92-kube-api-access-fcw85\") pod \"authorino-58cd955675-rsw2q\" (UID: \"01b18027-8227-448e-bcd0-1e5ec5fc5a92\") " pod="kuadrant-system/authorino-58cd955675-rsw2q"
Jul 09 17:35:11.886979 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.886715    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9fjb\" (UniqueName: \"kubernetes.io/projected/3088c6c3-4fa0-4d00-96a4-fda7970764fa-kube-api-access-f9fjb\") pod \"authorino-75d556bd77-zhkf2\" (UID: \"3088c6c3-4fa0-4d00-96a4-fda7970764fa\") " pod="kuadrant-system/authorino-75d556bd77-zhkf2"
Jul 09 17:35:11.894243 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.894214    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcw85\" (UniqueName: \"kubernetes.io/projected/01b18027-8227-448e-bcd0-1e5ec5fc5a92-kube-api-access-fcw85\") pod \"authorino-58cd955675-rsw2q\" (UID: \"01b18027-8227-448e-bcd0-1e5ec5fc5a92\") " pod="kuadrant-system/authorino-58cd955675-rsw2q"
Jul 09 17:35:11.984744 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.984689    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rsw2q"
Jul 09 17:35:11.987408 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.987386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9fjb\" (UniqueName: \"kubernetes.io/projected/3088c6c3-4fa0-4d00-96a4-fda7970764fa-kube-api-access-f9fjb\") pod \"authorino-75d556bd77-zhkf2\" (UID: \"3088c6c3-4fa0-4d00-96a4-fda7970764fa\") " pod="kuadrant-system/authorino-75d556bd77-zhkf2"
Jul 09 17:35:11.994953 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:11.994932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9fjb\" (UniqueName: \"kubernetes.io/projected/3088c6c3-4fa0-4d00-96a4-fda7970764fa-kube-api-access-f9fjb\") pod \"authorino-75d556bd77-zhkf2\" (UID: \"3088c6c3-4fa0-4d00-96a4-fda7970764fa\") " pod="kuadrant-system/authorino-75d556bd77-zhkf2"
Jul 09 17:35:12.108473 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:12.108450    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsw2q"]
Jul 09 17:35:12.109883 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:35:12.109862    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01b18027_8227_448e_bcd0_1e5ec5fc5a92.slice/crio-62327aef31ddc0e2e04f391e9ba1c6e3b52603a6959a4abf57b58d2b7061f733 WatchSource:0}: Error finding container 62327aef31ddc0e2e04f391e9ba1c6e3b52603a6959a4abf57b58d2b7061f733: Status 404 returned error can't find the container with id 62327aef31ddc0e2e04f391e9ba1c6e3b52603a6959a4abf57b58d2b7061f733
Jul 09 17:35:12.156216 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:12.156174    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zhkf2"
Jul 09 17:35:12.278543 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:12.278520    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zhkf2"]
Jul 09 17:35:12.280183 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:35:12.280159    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3088c6c3_4fa0_4d00_96a4_fda7970764fa.slice/crio-7d6b8b2aa82c0ddb99b1779e38bd5bc0e33a7b30664e429fe8db9f927bda698b WatchSource:0}: Error finding container 7d6b8b2aa82c0ddb99b1779e38bd5bc0e33a7b30664e429fe8db9f927bda698b: Status 404 returned error can't find the container with id 7d6b8b2aa82c0ddb99b1779e38bd5bc0e33a7b30664e429fe8db9f927bda698b
Jul 09 17:35:12.637347 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:12.637308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zhkf2" event={"ID":"3088c6c3-4fa0-4d00-96a4-fda7970764fa","Type":"ContainerStarted","Data":"7d6b8b2aa82c0ddb99b1779e38bd5bc0e33a7b30664e429fe8db9f927bda698b"}
Jul 09 17:35:12.638427 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:12.638404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rsw2q" event={"ID":"01b18027-8227-448e-bcd0-1e5ec5fc5a92","Type":"ContainerStarted","Data":"62327aef31ddc0e2e04f391e9ba1c6e3b52603a6959a4abf57b58d2b7061f733"}
Jul 09 17:35:16.669844 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:16.669807    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zhkf2" event={"ID":"3088c6c3-4fa0-4d00-96a4-fda7970764fa","Type":"ContainerStarted","Data":"f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff"}
Jul 09 17:35:16.670241 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:16.669858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rsw2q" event={"ID":"01b18027-8227-448e-bcd0-1e5ec5fc5a92","Type":"ContainerStarted","Data":"8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3"}
Jul 09 17:35:16.685611 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:16.685563    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rsw2q" podStartSLOduration=1.821232219 podStartE2EDuration="5.685549121s" totalImagesPullingTime="3.864316902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:35:16.683742546 +0000 UTC m=+440.466461878" watchObservedRunningTime="2026-07-09 17:35:16.685549121 +0000 UTC m=+440.468268452"
Jul 09 17:35:16.697601 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:16.697561    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zhkf2" podStartSLOduration=2.01576571 podStartE2EDuration="5.697548155s" totalImagesPullingTime="3.681782445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:35:16.697155261 +0000 UTC m=+440.479874591" watchObservedRunningTime="2026-07-09 17:35:16.697548155 +0000 UTC m=+440.480267485"
Jul 09 17:35:16.720268 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:16.720244    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsw2q"]
Jul 09 17:35:18.674813 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:18.674726    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rsw2q" podUID="01b18027-8227-448e-bcd0-1e5ec5fc5a92" containerName="authorino" containerID="cri-o://8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3" gracePeriod=30
Jul 09 17:35:18.911779 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:18.911755    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rsw2q"
Jul 09 17:35:18.946552 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:18.946492    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcw85\" (UniqueName: \"kubernetes.io/projected/01b18027-8227-448e-bcd0-1e5ec5fc5a92-kube-api-access-fcw85\") pod \"01b18027-8227-448e-bcd0-1e5ec5fc5a92\" (UID: \"01b18027-8227-448e-bcd0-1e5ec5fc5a92\") "
Jul 09 17:35:18.948363 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:18.948339    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b18027-8227-448e-bcd0-1e5ec5fc5a92-kube-api-access-fcw85" (OuterVolumeSpecName: "kube-api-access-fcw85") pod "01b18027-8227-448e-bcd0-1e5ec5fc5a92" (UID: "01b18027-8227-448e-bcd0-1e5ec5fc5a92"). InnerVolumeSpecName "kube-api-access-fcw85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:35:19.047298 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.047275    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcw85\" (UniqueName: \"kubernetes.io/projected/01b18027-8227-448e-bcd0-1e5ec5fc5a92-kube-api-access-fcw85\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:19.680905 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.680870    2583 generic.go:356] "Generic (PLEG): container finished" podID="01b18027-8227-448e-bcd0-1e5ec5fc5a92" containerID="8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3" exitCode=0
Jul 09 17:35:19.681309 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.680912    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rsw2q"
Jul 09 17:35:19.681309 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.680955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rsw2q" event={"ID":"01b18027-8227-448e-bcd0-1e5ec5fc5a92","Type":"ContainerDied","Data":"8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3"}
Jul 09 17:35:19.681309 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.680997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rsw2q" event={"ID":"01b18027-8227-448e-bcd0-1e5ec5fc5a92","Type":"ContainerDied","Data":"62327aef31ddc0e2e04f391e9ba1c6e3b52603a6959a4abf57b58d2b7061f733"}
Jul 09 17:35:19.681309 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.681018    2583 scope.go:117] "RemoveContainer" containerID="8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3"
Jul 09 17:35:19.689622 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.689603    2583 scope.go:117] "RemoveContainer" containerID="8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3"
Jul 09 17:35:19.689856 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:35:19.689838    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3\": container with ID starting with 8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3 not found: ID does not exist" containerID="8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3"
Jul 09 17:35:19.689902 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.689864    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3"} err="failed to get container status \"8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3\": rpc error: code = NotFound desc = could not find container \"8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3\": container with ID starting with 8b8c39e87000192846120d6d3f7913d45e87bdc56e8cb2329ddb83053215c8d3 not found: ID does not exist"
Jul 09 17:35:19.701710 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.701687    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsw2q"]
Jul 09 17:35:19.705144 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:19.705125    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rsw2q"]
Jul 09 17:35:20.670450 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:20.670416    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01b18027-8227-448e-bcd0-1e5ec5fc5a92" path="/var/lib/kubelet/pods/01b18027-8227-448e-bcd0-1e5ec5fc5a92/volumes"
Jul 09 17:35:27.048788 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:27.048749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:27.136449 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:27.136418    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:27.583116 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:27.583075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:39.532098 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.532057    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:39.665003 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.664968    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:39.749743 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.749712    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8c5j6"]
Jul 09 17:35:39.750085 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.750072    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b18027-8227-448e-bcd0-1e5ec5fc5a92" containerName="authorino"
Jul 09 17:35:39.750128 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.750087    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b18027-8227-448e-bcd0-1e5ec5fc5a92" containerName="authorino"
Jul 09 17:35:39.750170 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.750142    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b18027-8227-448e-bcd0-1e5ec5fc5a92" containerName="authorino"
Jul 09 17:35:39.836392 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.836372    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8c5j6"]
Jul 09 17:35:39.836531 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.836458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8c5j6"
Jul 09 17:35:39.906274 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.906244    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvgb4\" (UniqueName: \"kubernetes.io/projected/1fcbbe6b-0289-4245-b337-ede45965a095-kube-api-access-tvgb4\") pod \"authorino-5d4b67c446-8c5j6\" (UID: \"1fcbbe6b-0289-4245-b337-ede45965a095\") " pod="kuadrant-system/authorino-5d4b67c446-8c5j6"
Jul 09 17:35:39.999341 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:39.999316    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8c5j6"]
Jul 09 17:35:39.999539 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:35:39.999520    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tvgb4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-8c5j6" podUID="1fcbbe6b-0289-4245-b337-ede45965a095"
Jul 09 17:35:40.007575 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.007536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvgb4\" (UniqueName: \"kubernetes.io/projected/1fcbbe6b-0289-4245-b337-ede45965a095-kube-api-access-tvgb4\") pod \"authorino-5d4b67c446-8c5j6\" (UID: \"1fcbbe6b-0289-4245-b337-ede45965a095\") " pod="kuadrant-system/authorino-5d4b67c446-8c5j6"
Jul 09 17:35:40.020408 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.020386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvgb4\" (UniqueName: \"kubernetes.io/projected/1fcbbe6b-0289-4245-b337-ede45965a095-kube-api-access-tvgb4\") pod \"authorino-5d4b67c446-8c5j6\" (UID: \"1fcbbe6b-0289-4245-b337-ede45965a095\") " pod="kuadrant-system/authorino-5d4b67c446-8c5j6"
Jul 09 17:35:40.026691 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.026669    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f4594fc6f-x4vst"]
Jul 09 17:35:40.030574 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.030558    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f4594fc6f-x4vst"
Jul 09 17:35:40.035150 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.035131    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f4594fc6f-x4vst"]
Jul 09 17:35:40.107932 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.107877    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54l24\" (UniqueName: \"kubernetes.io/projected/94225c78-9709-470c-98f8-30f2d4e4f281-kube-api-access-54l24\") pod \"authorino-6f4594fc6f-x4vst\" (UID: \"94225c78-9709-470c-98f8-30f2d4e4f281\") " pod="kuadrant-system/authorino-6f4594fc6f-x4vst"
Jul 09 17:35:40.131139 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.131120    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f4594fc6f-x4vst"]
Jul 09 17:35:40.131335 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:35:40.131318    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-54l24], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6f4594fc6f-x4vst" podUID="94225c78-9709-470c-98f8-30f2d4e4f281"
Jul 09 17:35:40.157990 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.157961    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69c5f8d5d5-mf5jj"]
Jul 09 17:35:40.161232 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.161192    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:35:40.164037 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.164020    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 17:35:40.167713 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.167693    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69c5f8d5d5-mf5jj"]
Jul 09 17:35:40.208931 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.208905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54l24\" (UniqueName: \"kubernetes.io/projected/94225c78-9709-470c-98f8-30f2d4e4f281-kube-api-access-54l24\") pod \"authorino-6f4594fc6f-x4vst\" (UID: \"94225c78-9709-470c-98f8-30f2d4e4f281\") " pod="kuadrant-system/authorino-6f4594fc6f-x4vst"
Jul 09 17:35:40.216810 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.216785    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54l24\" (UniqueName: \"kubernetes.io/projected/94225c78-9709-470c-98f8-30f2d4e4f281-kube-api-access-54l24\") pod \"authorino-6f4594fc6f-x4vst\" (UID: \"94225c78-9709-470c-98f8-30f2d4e4f281\") " pod="kuadrant-system/authorino-6f4594fc6f-x4vst"
Jul 09 17:35:40.309477 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.309453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-tls-cert\") pod \"authorino-69c5f8d5d5-mf5jj\" (UID: \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\") " pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:35:40.309572 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.309515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7flbr\" (UniqueName: \"kubernetes.io/projected/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-kube-api-access-7flbr\") pod \"authorino-69c5f8d5d5-mf5jj\" (UID: \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\") " pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:35:40.410163 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.410098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-tls-cert\") pod \"authorino-69c5f8d5d5-mf5jj\" (UID: \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\") " pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:35:40.410288 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.410192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7flbr\" (UniqueName: \"kubernetes.io/projected/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-kube-api-access-7flbr\") pod \"authorino-69c5f8d5d5-mf5jj\" (UID: \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\") " pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:35:40.412580 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.412563    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-tls-cert\") pod \"authorino-69c5f8d5d5-mf5jj\" (UID: \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\") " pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:35:40.417573 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.417549    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7flbr\" (UniqueName: \"kubernetes.io/projected/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-kube-api-access-7flbr\") pod \"authorino-69c5f8d5d5-mf5jj\" (UID: \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\") " pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:35:40.469675 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.469658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:35:40.593638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.593613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69c5f8d5d5-mf5jj"]
Jul 09 17:35:40.595052 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:35:40.595025    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dd0c773_1d8a_4d6b_9191_ec6fabfbccaa.slice/crio-272504ebe35b0b19eabafa3eee8b343eca56b299a4e1f3d9002358c5acba95ae WatchSource:0}: Error finding container 272504ebe35b0b19eabafa3eee8b343eca56b299a4e1f3d9002358c5acba95ae: Status 404 returned error can't find the container with id 272504ebe35b0b19eabafa3eee8b343eca56b299a4e1f3d9002358c5acba95ae
Jul 09 17:35:40.786506 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.786448    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f4594fc6f-x4vst"
Jul 09 17:35:40.786506 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.786468    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj" event={"ID":"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa","Type":"ContainerStarted","Data":"272504ebe35b0b19eabafa3eee8b343eca56b299a4e1f3d9002358c5acba95ae"}
Jul 09 17:35:40.786650 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.786588    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8c5j6"
Jul 09 17:35:40.794552 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.794535    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f4594fc6f-x4vst"
Jul 09 17:35:40.796663 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.796649    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8c5j6"
Jul 09 17:35:40.914016 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.913986    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvgb4\" (UniqueName: \"kubernetes.io/projected/1fcbbe6b-0289-4245-b337-ede45965a095-kube-api-access-tvgb4\") pod \"1fcbbe6b-0289-4245-b337-ede45965a095\" (UID: \"1fcbbe6b-0289-4245-b337-ede45965a095\") "
Jul 09 17:35:40.914142 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.914042    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54l24\" (UniqueName: \"kubernetes.io/projected/94225c78-9709-470c-98f8-30f2d4e4f281-kube-api-access-54l24\") pod \"94225c78-9709-470c-98f8-30f2d4e4f281\" (UID: \"94225c78-9709-470c-98f8-30f2d4e4f281\") "
Jul 09 17:35:40.916054 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.916030    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fcbbe6b-0289-4245-b337-ede45965a095-kube-api-access-tvgb4" (OuterVolumeSpecName: "kube-api-access-tvgb4") pod "1fcbbe6b-0289-4245-b337-ede45965a095" (UID: "1fcbbe6b-0289-4245-b337-ede45965a095"). InnerVolumeSpecName "kube-api-access-tvgb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:35:40.916288 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:40.916271    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94225c78-9709-470c-98f8-30f2d4e4f281-kube-api-access-54l24" (OuterVolumeSpecName: "kube-api-access-54l24") pod "94225c78-9709-470c-98f8-30f2d4e4f281" (UID: "94225c78-9709-470c-98f8-30f2d4e4f281"). InnerVolumeSpecName "kube-api-access-54l24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:35:41.014430 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.014410    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvgb4\" (UniqueName: \"kubernetes.io/projected/1fcbbe6b-0289-4245-b337-ede45965a095-kube-api-access-tvgb4\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:41.014430 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.014431    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54l24\" (UniqueName: \"kubernetes.io/projected/94225c78-9709-470c-98f8-30f2d4e4f281-kube-api-access-54l24\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:41.792582 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.792547    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8c5j6"
Jul 09 17:35:41.792972 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.792580    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj" event={"ID":"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa","Type":"ContainerStarted","Data":"be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2"}
Jul 09 17:35:41.792972 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.792734    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f4594fc6f-x4vst"
Jul 09 17:35:41.814920 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.814877    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj" podStartSLOduration=1.379743099 podStartE2EDuration="1.81486326s" totalImagesPullingTime="435.120161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:35:41.813933293 +0000 UTC m=+465.596652628" watchObservedRunningTime="2026-07-09 17:35:41.81486326 +0000 UTC m=+465.597582591"
Jul 09 17:35:41.837531 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.837501    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f4594fc6f-x4vst"]
Jul 09 17:35:41.843228 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.843190    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zhkf2"]
Jul 09 17:35:41.843405 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.843383    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zhkf2" podUID="3088c6c3-4fa0-4d00-96a4-fda7970764fa" containerName="authorino" containerID="cri-o://f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff" gracePeriod=30
Jul 09 17:35:41.847292 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.847271    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f4594fc6f-x4vst"]
Jul 09 17:35:41.866661 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.866640    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8c5j6"]
Jul 09 17:35:41.870049 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:41.870029    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8c5j6"]
Jul 09 17:35:42.078481 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.078456    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zhkf2"
Jul 09 17:35:42.224618 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.224582    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9fjb\" (UniqueName: \"kubernetes.io/projected/3088c6c3-4fa0-4d00-96a4-fda7970764fa-kube-api-access-f9fjb\") pod \"3088c6c3-4fa0-4d00-96a4-fda7970764fa\" (UID: \"3088c6c3-4fa0-4d00-96a4-fda7970764fa\") "
Jul 09 17:35:42.226656 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.226628    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3088c6c3-4fa0-4d00-96a4-fda7970764fa-kube-api-access-f9fjb" (OuterVolumeSpecName: "kube-api-access-f9fjb") pod "3088c6c3-4fa0-4d00-96a4-fda7970764fa" (UID: "3088c6c3-4fa0-4d00-96a4-fda7970764fa"). InnerVolumeSpecName "kube-api-access-f9fjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:35:42.325327 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.325269    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9fjb\" (UniqueName: \"kubernetes.io/projected/3088c6c3-4fa0-4d00-96a4-fda7970764fa-kube-api-access-f9fjb\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:35:42.670376 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.670350    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fcbbe6b-0289-4245-b337-ede45965a095" path="/var/lib/kubelet/pods/1fcbbe6b-0289-4245-b337-ede45965a095/volumes"
Jul 09 17:35:42.670564 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.670553    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94225c78-9709-470c-98f8-30f2d4e4f281" path="/var/lib/kubelet/pods/94225c78-9709-470c-98f8-30f2d4e4f281/volumes"
Jul 09 17:35:42.798249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.798219    2583 generic.go:356] "Generic (PLEG): container finished" podID="3088c6c3-4fa0-4d00-96a4-fda7970764fa" containerID="f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff" exitCode=0
Jul 09 17:35:42.798553 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.798261    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zhkf2"
Jul 09 17:35:42.798553 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.798301    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zhkf2" event={"ID":"3088c6c3-4fa0-4d00-96a4-fda7970764fa","Type":"ContainerDied","Data":"f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff"}
Jul 09 17:35:42.798553 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.798340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zhkf2" event={"ID":"3088c6c3-4fa0-4d00-96a4-fda7970764fa","Type":"ContainerDied","Data":"7d6b8b2aa82c0ddb99b1779e38bd5bc0e33a7b30664e429fe8db9f927bda698b"}
Jul 09 17:35:42.798553 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.798361    2583 scope.go:117] "RemoveContainer" containerID="f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff"
Jul 09 17:35:42.807431 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.807414    2583 scope.go:117] "RemoveContainer" containerID="f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff"
Jul 09 17:35:42.807733 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:35:42.807711    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff\": container with ID starting with f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff not found: ID does not exist" containerID="f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff"
Jul 09 17:35:42.807837 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.807737    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff"} err="failed to get container status \"f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff\": rpc error: code = NotFound desc = could not find container \"f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff\": container with ID starting with f760e68d70e4a6f547b6653c61ac7bd125b2a309274209e7baba9cc48b5879ff not found: ID does not exist"
Jul 09 17:35:42.815671 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.815650    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zhkf2"]
Jul 09 17:35:42.818897 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:42.818876    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zhkf2"]
Jul 09 17:35:43.348123 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:43.348095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:43.448872 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:43.448847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:44.670213 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:44.670175    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3088c6c3-4fa0-4d00-96a4-fda7970764fa" path="/var/lib/kubelet/pods/3088c6c3-4fa0-4d00-96a4-fda7970764fa/volumes"
Jul 09 17:35:46.258051 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:46.258020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:46.354674 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:46.354645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:46.444907 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:46.444877    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:50.008094 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:50.008058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:35:50.114658 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:35:50.114623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:21.463485 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:21.463445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:21.809080 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:21.808997    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:22.046179 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.046138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:22.248652 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.248618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:22.345909 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.345872    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:22.376581 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.376552    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-nlhcd"]
Jul 09 17:36:22.376871 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.376859    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3088c6c3-4fa0-4d00-96a4-fda7970764fa" containerName="authorino"
Jul 09 17:36:22.376919 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.376872    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3088c6c3-4fa0-4d00-96a4-fda7970764fa" containerName="authorino"
Jul 09 17:36:22.376957 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.376934    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3088c6c3-4fa0-4d00-96a4-fda7970764fa" containerName="authorino"
Jul 09 17:36:22.379789 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.379774    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:22.382470 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.382447    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zwghr\""
Jul 09 17:36:22.382567 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.382516    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 17:36:22.387905 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.387882    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-nlhcd"]
Jul 09 17:36:22.411882 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.411861    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-brzrj"]
Jul 09 17:36:22.413365 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.413344    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5whg\" (UniqueName: \"kubernetes.io/projected/ad473846-6c22-491a-85c7-fa6478b7edc5-kube-api-access-t5whg\") pod \"payload-processing-58f86c7798-nlhcd\" (UID: \"ad473846-6c22-491a-85c7-fa6478b7edc5\") " pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:22.413446 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.413378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad473846-6c22-491a-85c7-fa6478b7edc5-plugins-config-volume\") pod \"payload-processing-58f86c7798-nlhcd\" (UID: \"ad473846-6c22-491a-85c7-fa6478b7edc5\") " pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:22.414944 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.414930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:22.424360 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.424340    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-brzrj"]
Jul 09 17:36:22.514237 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.514160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc167e09-6c38-4d5b-8eb1-dfdda59b204c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-brzrj\" (UID: \"dc167e09-6c38-4d5b-8eb1-dfdda59b204c\") " pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:22.514540 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.514242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5whg\" (UniqueName: \"kubernetes.io/projected/ad473846-6c22-491a-85c7-fa6478b7edc5-kube-api-access-t5whg\") pod \"payload-processing-58f86c7798-nlhcd\" (UID: \"ad473846-6c22-491a-85c7-fa6478b7edc5\") " pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:22.514540 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.514265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l75j\" (UniqueName: \"kubernetes.io/projected/dc167e09-6c38-4d5b-8eb1-dfdda59b204c-kube-api-access-5l75j\") pod \"payload-pre-processing-7964457696-brzrj\" (UID: \"dc167e09-6c38-4d5b-8eb1-dfdda59b204c\") " pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:22.514540 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.514297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad473846-6c22-491a-85c7-fa6478b7edc5-plugins-config-volume\") pod \"payload-processing-58f86c7798-nlhcd\" (UID: \"ad473846-6c22-491a-85c7-fa6478b7edc5\") " pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:22.514867 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.514849    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad473846-6c22-491a-85c7-fa6478b7edc5-plugins-config-volume\") pod \"payload-processing-58f86c7798-nlhcd\" (UID: \"ad473846-6c22-491a-85c7-fa6478b7edc5\") " pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:22.522128 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.522107    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5whg\" (UniqueName: \"kubernetes.io/projected/ad473846-6c22-491a-85c7-fa6478b7edc5-kube-api-access-t5whg\") pod \"payload-processing-58f86c7798-nlhcd\" (UID: \"ad473846-6c22-491a-85c7-fa6478b7edc5\") " pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:22.614974 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.614948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l75j\" (UniqueName: \"kubernetes.io/projected/dc167e09-6c38-4d5b-8eb1-dfdda59b204c-kube-api-access-5l75j\") pod \"payload-pre-processing-7964457696-brzrj\" (UID: \"dc167e09-6c38-4d5b-8eb1-dfdda59b204c\") " pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:22.615089 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.614995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc167e09-6c38-4d5b-8eb1-dfdda59b204c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-brzrj\" (UID: \"dc167e09-6c38-4d5b-8eb1-dfdda59b204c\") " pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:22.615627 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.615610    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc167e09-6c38-4d5b-8eb1-dfdda59b204c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-brzrj\" (UID: \"dc167e09-6c38-4d5b-8eb1-dfdda59b204c\") " pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:22.623841 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.623815    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l75j\" (UniqueName: \"kubernetes.io/projected/dc167e09-6c38-4d5b-8eb1-dfdda59b204c-kube-api-access-5l75j\") pod \"payload-pre-processing-7964457696-brzrj\" (UID: \"dc167e09-6c38-4d5b-8eb1-dfdda59b204c\") " pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:22.690131 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.690105    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:22.724333 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.724305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:22.831929 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.831849    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-nlhcd"]
Jul 09 17:36:22.833811 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:36:22.833786    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad473846_6c22_491a_85c7_fa6478b7edc5.slice/crio-3dad99e9fba3e56dddad4ee9ac6ca292718d5266655011519c1efdfa4d2aef66 WatchSource:0}: Error finding container 3dad99e9fba3e56dddad4ee9ac6ca292718d5266655011519c1efdfa4d2aef66: Status 404 returned error can't find the container with id 3dad99e9fba3e56dddad4ee9ac6ca292718d5266655011519c1efdfa4d2aef66
Jul 09 17:36:22.860180 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.860160    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-brzrj"]
Jul 09 17:36:22.861417 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:36:22.861389    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc167e09_6c38_4d5b_8eb1_dfdda59b204c.slice/crio-9d2a1fe57675ce16e5d39b81c5222065cdb8171b1b3bb1acdf0096c56f7cc3d3 WatchSource:0}: Error finding container 9d2a1fe57675ce16e5d39b81c5222065cdb8171b1b3bb1acdf0096c56f7cc3d3: Status 404 returned error can't find the container with id 9d2a1fe57675ce16e5d39b81c5222065cdb8171b1b3bb1acdf0096c56f7cc3d3
Jul 09 17:36:22.996138 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.996100    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-nlhcd" event={"ID":"ad473846-6c22-491a-85c7-fa6478b7edc5","Type":"ContainerStarted","Data":"3dad99e9fba3e56dddad4ee9ac6ca292718d5266655011519c1efdfa4d2aef66"}
Jul 09 17:36:22.997144 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:22.997121    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-brzrj" event={"ID":"dc167e09-6c38-4d5b-8eb1-dfdda59b204c","Type":"ContainerStarted","Data":"9d2a1fe57675ce16e5d39b81c5222065cdb8171b1b3bb1acdf0096c56f7cc3d3"}
Jul 09 17:36:25.010483 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:25.010447    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-nlhcd" event={"ID":"ad473846-6c22-491a-85c7-fa6478b7edc5","Type":"ContainerStarted","Data":"0d4a2792f58e136647bf8da4ca215e9775fd282c14bcc4d42b7d8c8334157a27"}
Jul 09 17:36:25.010929 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:25.010623    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:25.012150 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:25.012126    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-brzrj" event={"ID":"dc167e09-6c38-4d5b-8eb1-dfdda59b204c","Type":"ContainerStarted","Data":"d2c454f10af166c689567fdb71fb182fb8b3acc442c11bec0660fafb0bca40e9"}
Jul 09 17:36:25.012302 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:25.012167    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:25.028769 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:25.028728    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-nlhcd" podStartSLOduration=1.4368955460000001 podStartE2EDuration="3.028715305s" totalImagesPullingTime="1.591819759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:36:25.026383512 +0000 UTC m=+508.809102844" watchObservedRunningTime="2026-07-09 17:36:25.028715305 +0000 UTC m=+508.811434636"
Jul 09 17:36:25.042812 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:25.042777    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-brzrj" podStartSLOduration=1.480815124 podStartE2EDuration="3.042764457s" totalImagesPullingTime="1.561949333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:36:25.040919483 +0000 UTC m=+508.823638815" watchObservedRunningTime="2026-07-09 17:36:25.042764457 +0000 UTC m=+508.825483788"
Jul 09 17:36:32.962649 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:32.962618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:33.062800 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:33.062771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:35.263545 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:35.263486    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:35.377233 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:35.377185    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:36.018271 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:36.018237    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-nlhcd"
Jul 09 17:36:36.018448 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:36.018343    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-brzrj"
Jul 09 17:36:38.604673 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:38.604644    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:57.276360 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.276281    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"]
Jul 09 17:36:57.279906 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.279889    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.282646 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.282623    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 17:36:57.282772 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.282651    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 17:36:57.285259 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.285241    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 17:36:57.285555 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.285268    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c6gkt\""
Jul 09 17:36:57.288262 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.288241    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"]
Jul 09 17:36:57.314611 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.314589    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:57.368414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.368388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0282b38b-173c-424c-8b9d-5a2491b32321-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.368502 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.368440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.368543 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.368508    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.368543 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.368526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcp7z\" (UniqueName: \"kubernetes.io/projected/0282b38b-173c-424c-8b9d-5a2491b32321-kube-api-access-tcp7z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.368616 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.368568    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.368616 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.368596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.469045 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.469023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.469132 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.469049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcp7z\" (UniqueName: \"kubernetes.io/projected/0282b38b-173c-424c-8b9d-5a2491b32321-kube-api-access-tcp7z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.469132 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.469077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.469293 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.469273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.469341 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.469317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0282b38b-173c-424c-8b9d-5a2491b32321-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.469399 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.469382    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.469399 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.469394    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.469499 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.469479    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.469748 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.469729    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.471558 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.471527    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0282b38b-173c-424c-8b9d-5a2491b32321-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.471817 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.471801    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0282b38b-173c-424c-8b9d-5a2491b32321-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.478914 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.478889    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcp7z\" (UniqueName: \"kubernetes.io/projected/0282b38b-173c-424c-8b9d-5a2491b32321-kube-api-access-tcp7z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbgwv\" (UID: \"0282b38b-173c-424c-8b9d-5a2491b32321\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.594854 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.594832    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:36:57.724364 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:57.724334    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"]
Jul 09 17:36:57.726824 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:36:57.726798    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0282b38b_173c_424c_8b9d_5a2491b32321.slice/crio-c2165217a9f28346e135782171488a3135be3703deec24aa7ab8e7928f5a687c WatchSource:0}: Error finding container c2165217a9f28346e135782171488a3135be3703deec24aa7ab8e7928f5a687c: Status 404 returned error can't find the container with id c2165217a9f28346e135782171488a3135be3703deec24aa7ab8e7928f5a687c
Jul 09 17:36:58.183530 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:58.183492    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv" event={"ID":"0282b38b-173c-424c-8b9d-5a2491b32321","Type":"ContainerStarted","Data":"c2165217a9f28346e135782171488a3135be3703deec24aa7ab8e7928f5a687c"}
Jul 09 17:36:59.007194 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:59.007157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:36:59.190464 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:59.190381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv" event={"ID":"0282b38b-173c-424c-8b9d-5a2491b32321","Type":"ContainerStarted","Data":"7f1a482bbb5bd3d9e320d9b79b3a966f542f9f2dc328f878bf9683f9a4b2d008"}
Jul 09 17:36:59.208641 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:36:59.208595    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv" podStartSLOduration=1.107292168 podStartE2EDuration="2.208578607s" totalImagesPullingTime="1.101286439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:36:59.206611584 +0000 UTC m=+542.989330941" watchObservedRunningTime="2026-07-09 17:36:59.208578607 +0000 UTC m=+542.991297937"
Jul 09 17:37:01.300678 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:01.300644    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:07.381375 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.381342    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"]
Jul 09 17:37:07.384753 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.384737    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.387490 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.387464    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 17:37:07.392727 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.392703    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"]
Jul 09 17:37:07.451080 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.451055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7qjt\" (UniqueName: \"kubernetes.io/projected/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-kube-api-access-k7qjt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.451187 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.451108    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.451187 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.451150    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.451187 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.451171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.451321 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.451249    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.451321 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.451269    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.468439 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.468412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:07.552524 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.552498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.552629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.552531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.552629 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.552581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7qjt\" (UniqueName: \"kubernetes.io/projected/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-kube-api-access-k7qjt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.552745 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.552632    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.552745 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.552664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.552745 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.552693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.553056 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.553033    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.553185 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.553074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.553185 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.553158    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.554830 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.554808    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.555007 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.554986    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.562367 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.562340    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7qjt\" (UniqueName: \"kubernetes.io/projected/d492bbc2-160e-49a1-b113-3f6b9cd8a7b4-kube-api-access-k7qjt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw\" (UID: \"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.594913 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.594887    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:37:07.595001 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.594941    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:37:07.607292 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.607276    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:37:07.695716 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.695657    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:07.823550 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:07.823514    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"]
Jul 09 17:37:07.824633 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:37:07.824608    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd492bbc2_160e_49a1_b113_3f6b9cd8a7b4.slice/crio-231a2554dd3f257642310a4b0a31dc15ba67450a7968f69c92fcbae87b490364 WatchSource:0}: Error finding container 231a2554dd3f257642310a4b0a31dc15ba67450a7968f69c92fcbae87b490364: Status 404 returned error can't find the container with id 231a2554dd3f257642310a4b0a31dc15ba67450a7968f69c92fcbae87b490364
Jul 09 17:37:08.234990 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:08.234946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw" event={"ID":"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4","Type":"ContainerStarted","Data":"bd76dfce8a64728e8d1ce3ab15991fc26100a64d1992b455b8f6a906a1bbb6e3"}
Jul 09 17:37:08.235178 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:08.235032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw" event={"ID":"d492bbc2-160e-49a1-b113-3f6b9cd8a7b4","Type":"ContainerStarted","Data":"231a2554dd3f257642310a4b0a31dc15ba67450a7968f69c92fcbae87b490364"}
Jul 09 17:37:08.246310 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:08.246283    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbgwv"
Jul 09 17:37:08.256076 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:08.256032    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw" podStartSLOduration=1.041991912 podStartE2EDuration="1.256021399s" totalImagesPullingTime="214.029487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:37:08.253861688 +0000 UTC m=+552.036581021" watchObservedRunningTime="2026-07-09 17:37:08.256021399 +0000 UTC m=+552.038740780"
Jul 09 17:37:13.889502 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:13.889467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:17.696084 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:17.696053    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:17.696507 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:17.696125    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:17.708777 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:17.708744    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:18.295848 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:18.295822    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw"
Jul 09 17:37:29.896505 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:29.896469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:37:56.558899 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:56.558870    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:37:56.559401 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:37:56.559231    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:38:28.942219 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:28.942106    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:40.180323 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:40.180290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:45.231497 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:45.231464    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:45.290124 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:45.290093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:52.505103 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:52.505068    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:54.060359 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.060332    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c8bd9df76-scqq4"]
Jul 09 17:38:54.063564 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.063544    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c8bd9df76-scqq4"
Jul 09 17:38:54.071702 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.071679    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c8bd9df76-scqq4"]
Jul 09 17:38:54.148146 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.148111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsz7n\" (UniqueName: \"kubernetes.io/projected/a5e64bc7-a504-4a91-aa40-f3b2e8e37930-kube-api-access-zsz7n\") pod \"authorino-5c8bd9df76-scqq4\" (UID: \"a5e64bc7-a504-4a91-aa40-f3b2e8e37930\") " pod="kuadrant-system/authorino-5c8bd9df76-scqq4"
Jul 09 17:38:54.148320 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.148228    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5e64bc7-a504-4a91-aa40-f3b2e8e37930-tls-cert\") pod \"authorino-5c8bd9df76-scqq4\" (UID: \"a5e64bc7-a504-4a91-aa40-f3b2e8e37930\") " pod="kuadrant-system/authorino-5c8bd9df76-scqq4"
Jul 09 17:38:54.249147 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.249120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5e64bc7-a504-4a91-aa40-f3b2e8e37930-tls-cert\") pod \"authorino-5c8bd9df76-scqq4\" (UID: \"a5e64bc7-a504-4a91-aa40-f3b2e8e37930\") " pod="kuadrant-system/authorino-5c8bd9df76-scqq4"
Jul 09 17:38:54.249272 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.249161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsz7n\" (UniqueName: \"kubernetes.io/projected/a5e64bc7-a504-4a91-aa40-f3b2e8e37930-kube-api-access-zsz7n\") pod \"authorino-5c8bd9df76-scqq4\" (UID: \"a5e64bc7-a504-4a91-aa40-f3b2e8e37930\") " pod="kuadrant-system/authorino-5c8bd9df76-scqq4"
Jul 09 17:38:54.251559 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.251542    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5e64bc7-a504-4a91-aa40-f3b2e8e37930-tls-cert\") pod \"authorino-5c8bd9df76-scqq4\" (UID: \"a5e64bc7-a504-4a91-aa40-f3b2e8e37930\") " pod="kuadrant-system/authorino-5c8bd9df76-scqq4"
Jul 09 17:38:54.256678 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.256653    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsz7n\" (UniqueName: \"kubernetes.io/projected/a5e64bc7-a504-4a91-aa40-f3b2e8e37930-kube-api-access-zsz7n\") pod \"authorino-5c8bd9df76-scqq4\" (UID: \"a5e64bc7-a504-4a91-aa40-f3b2e8e37930\") " pod="kuadrant-system/authorino-5c8bd9df76-scqq4"
Jul 09 17:38:54.374379 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.374357    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c8bd9df76-scqq4"
Jul 09 17:38:54.501988 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.501965    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c8bd9df76-scqq4"]
Jul 09 17:38:54.503808 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:38:54.503781    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5e64bc7_a504_4a91_aa40_f3b2e8e37930.slice/crio-1d28598bd2cdb41981dbf042b748f1780b78a5abbb06b5cf151a8869fc98b3c7 WatchSource:0}: Error finding container 1d28598bd2cdb41981dbf042b748f1780b78a5abbb06b5cf151a8869fc98b3c7: Status 404 returned error can't find the container with id 1d28598bd2cdb41981dbf042b748f1780b78a5abbb06b5cf151a8869fc98b3c7
Jul 09 17:38:54.765259 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:54.765163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c8bd9df76-scqq4" event={"ID":"a5e64bc7-a504-4a91-aa40-f3b2e8e37930","Type":"ContainerStarted","Data":"1d28598bd2cdb41981dbf042b748f1780b78a5abbb06b5cf151a8869fc98b3c7"}
Jul 09 17:38:55.774815 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:55.774760    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c8bd9df76-scqq4" event={"ID":"a5e64bc7-a504-4a91-aa40-f3b2e8e37930","Type":"ContainerStarted","Data":"c2023dd72296ddc3b6fc623bbb65f6c3ade5ac0ec64afb38968947d781406485"}
Jul 09 17:38:55.795031 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:55.794972    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c8bd9df76-scqq4" podStartSLOduration=1.343533872 podStartE2EDuration="1.79495396s" totalImagesPullingTime="451.420088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:38:55.791143092 +0000 UTC m=+659.573862424" watchObservedRunningTime="2026-07-09 17:38:55.79495396 +0000 UTC m=+659.577673294"
Jul 09 17:38:55.820357 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:55.820299    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69c5f8d5d5-mf5jj"]
Jul 09 17:38:55.821472 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:55.821028    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj" podUID="1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa" containerName="authorino" containerID="cri-o://be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2" gracePeriod=30
Jul 09 17:38:56.092108 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.092084    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:38:56.267080 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.267048    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-tls-cert\") pod \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\" (UID: \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\") "
Jul 09 17:38:56.267270 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.267144    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7flbr\" (UniqueName: \"kubernetes.io/projected/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-kube-api-access-7flbr\") pod \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\" (UID: \"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa\") "
Jul 09 17:38:56.269137 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.269102    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-kube-api-access-7flbr" (OuterVolumeSpecName: "kube-api-access-7flbr") pod "1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa" (UID: "1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa"). InnerVolumeSpecName "kube-api-access-7flbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:38:56.277430 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.277404    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa" (UID: "1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:38:56.368891 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.368844    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7flbr\" (UniqueName: \"kubernetes.io/projected/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-kube-api-access-7flbr\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:38:56.368891 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.368883    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa-tls-cert\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:38:56.378564 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.378533    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:56.478046 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.477963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:56.781673 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.781637    2583 generic.go:356] "Generic (PLEG): container finished" podID="1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa" containerID="be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2" exitCode=0
Jul 09 17:38:56.782120 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.781682    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj"
Jul 09 17:38:56.782120 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.781697    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj" event={"ID":"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa","Type":"ContainerDied","Data":"be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2"}
Jul 09 17:38:56.782120 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.781757    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69c5f8d5d5-mf5jj" event={"ID":"1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa","Type":"ContainerDied","Data":"272504ebe35b0b19eabafa3eee8b343eca56b299a4e1f3d9002358c5acba95ae"}
Jul 09 17:38:56.782120 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.781778    2583 scope.go:117] "RemoveContainer" containerID="be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2"
Jul 09 17:38:56.791608 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.791583    2583 scope.go:117] "RemoveContainer" containerID="be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2"
Jul 09 17:38:56.791879 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:38:56.791861    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2\": container with ID starting with be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2 not found: ID does not exist" containerID="be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2"
Jul 09 17:38:56.791939 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.791889    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2"} err="failed to get container status \"be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2\": rpc error: code = NotFound desc = could not find container \"be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2\": container with ID starting with be555ed98deedb151b3fadd6b6082e36201db0c9e2f34d7578ad372469e2a5c2 not found: ID does not exist"
Jul 09 17:38:56.802170 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.802150    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69c5f8d5d5-mf5jj"]
Jul 09 17:38:56.804752 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:56.804729    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69c5f8d5d5-mf5jj"]
Jul 09 17:38:57.770800 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:57.770763    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:57.868803 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:57.868775    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:38:58.675017 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:38:58.674984    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa" path="/var/lib/kubelet/pods/1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa/volumes"
Jul 09 17:40:11.330552 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:40:11.330516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:13.349353 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:40:13.349313    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:13.449259 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:40:13.449224    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:53.951835 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:40:53.951798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:54.055741 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:40:54.055708    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:40:54.165636 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:40:54.165597    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:00.041324 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:41:00.041273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:00.099262 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:41:00.099227    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:00.178827 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:41:00.178794    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:00.278312 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:41:00.278277    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:00.391448 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:41:00.391420    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:06.069415 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:41:06.069376    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:06.133337 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:41:06.133307    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:41:11.355734 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:41:11.355701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:42:56.596010 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:42:56.595920    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:42:56.597436 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:42:56.597416    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:45:00.148174 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.148144    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"]
Jul 09 17:45:00.150580 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.148494    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa" containerName="authorino"
Jul 09 17:45:00.150580 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.148506    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa" containerName="authorino"
Jul 09 17:45:00.150580 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.148578    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd0c773-1d8a-4d6b-9191-ec6fabfbccaa" containerName="authorino"
Jul 09 17:45:00.151507 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.151492    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"
Jul 09 17:45:00.154438 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.154416    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 17:45:00.154572 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.154489    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 17:45:00.155792 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.155773    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5lf9x\""
Jul 09 17:45:00.168025 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.168006    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"]
Jul 09 17:45:00.211038 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.211015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p7fh\" (UniqueName: \"kubernetes.io/projected/42ef1ca6-60b7-4029-96e3-618d22161961-kube-api-access-8p7fh\") pod \"maas-api-key-cleanup-29726985-ll9sm\" (UID: \"42ef1ca6-60b7-4029-96e3-618d22161961\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"
Jul 09 17:45:00.311947 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.311922    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p7fh\" (UniqueName: \"kubernetes.io/projected/42ef1ca6-60b7-4029-96e3-618d22161961-kube-api-access-8p7fh\") pod \"maas-api-key-cleanup-29726985-ll9sm\" (UID: \"42ef1ca6-60b7-4029-96e3-618d22161961\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"
Jul 09 17:45:00.320663 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.320631    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p7fh\" (UniqueName: \"kubernetes.io/projected/42ef1ca6-60b7-4029-96e3-618d22161961-kube-api-access-8p7fh\") pod \"maas-api-key-cleanup-29726985-ll9sm\" (UID: \"42ef1ca6-60b7-4029-96e3-618d22161961\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"
Jul 09 17:45:00.461844 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.461792    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"
Jul 09 17:45:00.490390 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.490361    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:45:00.586979 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.586949    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"]
Jul 09 17:45:00.588995 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:45:00.588969    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ef1ca6_60b7_4029_96e3_618d22161961.slice/crio-2129eec015536c9fc8196a10091df3bdc901f6fcd616c7d80b2cc2223ba7d812 WatchSource:0}: Error finding container 2129eec015536c9fc8196a10091df3bdc901f6fcd616c7d80b2cc2223ba7d812: Status 404 returned error can't find the container with id 2129eec015536c9fc8196a10091df3bdc901f6fcd616c7d80b2cc2223ba7d812
Jul 09 17:45:00.590861 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.590841    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 17:45:00.626849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:00.626824    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm" event={"ID":"42ef1ca6-60b7-4029-96e3-618d22161961","Type":"ContainerStarted","Data":"2129eec015536c9fc8196a10091df3bdc901f6fcd616c7d80b2cc2223ba7d812"}
Jul 09 17:45:04.653526 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:04.653487    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm" event={"ID":"42ef1ca6-60b7-4029-96e3-618d22161961","Type":"ContainerStarted","Data":"1a72ba74cc91c23f220d7484b19bfb8d56b5f72b2f65f4bf185de95d7d678a5f"}
Jul 09 17:45:04.670598 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:45:04.670552    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm" podStartSLOduration=1.687141947 podStartE2EDuration="4.670537015s" totalImagesPullingTime="2.983395068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:45:04.668712588 +0000 UTC m=+1028.451431920" watchObservedRunningTime="2026-07-09 17:45:04.670537015 +0000 UTC m=+1028.453256388"
Jul 09 17:46:00.011262 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:00.011152    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"]
Jul 09 17:46:00.011839 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:00.011441    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm" podUID="42ef1ca6-60b7-4029-96e3-618d22161961" containerName="cleanup" containerID="cri-o://1a72ba74cc91c23f220d7484b19bfb8d56b5f72b2f65f4bf185de95d7d678a5f" gracePeriod=30
Jul 09 17:46:23.582343 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:23.582299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:46:30.090809 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:30.090773    2583 generic.go:356] "Generic (PLEG): container finished" podID="42ef1ca6-60b7-4029-96e3-618d22161961" containerID="1a72ba74cc91c23f220d7484b19bfb8d56b5f72b2f65f4bf185de95d7d678a5f" exitCode=137
Jul 09 17:46:30.091150 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:30.090846    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm" event={"ID":"42ef1ca6-60b7-4029-96e3-618d22161961","Type":"ContainerDied","Data":"1a72ba74cc91c23f220d7484b19bfb8d56b5f72b2f65f4bf185de95d7d678a5f"}
Jul 09 17:46:30.195766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:30.195741    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"
Jul 09 17:46:30.299817 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:30.299746    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p7fh\" (UniqueName: \"kubernetes.io/projected/42ef1ca6-60b7-4029-96e3-618d22161961-kube-api-access-8p7fh\") pod \"42ef1ca6-60b7-4029-96e3-618d22161961\" (UID: \"42ef1ca6-60b7-4029-96e3-618d22161961\") "
Jul 09 17:46:30.301826 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:30.301798    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ef1ca6-60b7-4029-96e3-618d22161961-kube-api-access-8p7fh" (OuterVolumeSpecName: "kube-api-access-8p7fh") pod "42ef1ca6-60b7-4029-96e3-618d22161961" (UID: "42ef1ca6-60b7-4029-96e3-618d22161961"). InnerVolumeSpecName "kube-api-access-8p7fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:46:30.400813 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:30.400786    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p7fh\" (UniqueName: \"kubernetes.io/projected/42ef1ca6-60b7-4029-96e3-618d22161961-kube-api-access-8p7fh\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:46:31.097249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:31.097220    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"
Jul 09 17:46:31.097249 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:31.097225    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm" event={"ID":"42ef1ca6-60b7-4029-96e3-618d22161961","Type":"ContainerDied","Data":"2129eec015536c9fc8196a10091df3bdc901f6fcd616c7d80b2cc2223ba7d812"}
Jul 09 17:46:31.097817 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:31.097291    2583 scope.go:117] "RemoveContainer" containerID="1a72ba74cc91c23f220d7484b19bfb8d56b5f72b2f65f4bf185de95d7d678a5f"
Jul 09 17:46:31.114637 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:31.114612    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"]
Jul 09 17:46:31.117925 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:31.117902    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726985-ll9sm"]
Jul 09 17:46:32.670469 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:32.670439    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ef1ca6-60b7-4029-96e3-618d22161961" path="/var/lib/kubelet/pods/42ef1ca6-60b7-4029-96e3-618d22161961/volumes"
Jul 09 17:46:47.698905 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:46:47.698851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:02.272174 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:47:02.272118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:02.323964 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:47:02.323938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:47:56.637863 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:47:56.637828    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:47:56.638425 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:47:56.638015    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:52:12.158307 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:12.158219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:19.163645 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:19.163607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:27.231214 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:27.231159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:32.376539 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:32.376506    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:35.368847 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:35.368818    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:35.462420 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:35.462384    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:35.796576 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:35.796503    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:41.383082 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:41.383048    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:41.441114 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:41.441085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:41.591078 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:41.591046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:41.651604 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:41.651540    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:42.694061 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:42.694030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:42.775065 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:42.775028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:42.843126 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:42.843097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:43.034786 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:43.034701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:43.470138 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:43.470105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:43.568130 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:43.568100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:45.102414 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:45.102386    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:50.898207 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:50.898160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:50.951959 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:50.951936    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:51.061843 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:51.061813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:51.170003 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:51.169912    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:52.937808 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:52.937780    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:56.677430 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:56.677405    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:52:56.683265 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:56.683241    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:52:56.867719 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:56.867690    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:56.928041 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:56.927954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:57.063015 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:57.062987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:57.163766 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:57.163736    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:58.156285 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:58.156250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:58.261251 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:58.261212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:58.413478 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:58.413390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:58.515238 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:58.515181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:58.934611 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:58.934569    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:52:59.035690 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:52:59.035651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:00.314040 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:00.314000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:06.335192 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:06.335160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:06.435321 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:06.435292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:07.316621 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:07.316586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:07.423612 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:07.423576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:10.577662 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:10.577633    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:13.075738 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:13.075704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:13.134355 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:13.134325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:13.275157 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:13.275130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:13.374709 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:13.374686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:14.367890 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:14.367864    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:14.459019 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:14.458994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:14.525455 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:14.525427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:14.589700 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:14.589669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:15.033073 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:15.033041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:15.135145 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:15.135115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:16.491630 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:16.491600    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:21.846913 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:21.846802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:21.899813 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:21.899781    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:22.043311 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:22.043287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:22.172830 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:22.172764    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:23.904446 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:23.904419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:27.651143 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:27.651105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:27.717434 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:27.717400    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:28.149408 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:28.149375    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:28.249740 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:28.249714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:28.350258 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:28.350231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:39.917562 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:39.917522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:53:59.748410 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:53:59.748377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:05.331536 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:05.331490    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:10.897446 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:10.897409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:11.006055 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:11.006028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:11.097840 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:11.097810    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:11.197781 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:11.197717    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:11.718750 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:11.718712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:21.008849 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:21.008813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:21.060509 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:21.060481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:37.716809 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:37.716771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:43.345572 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:43.345539    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:43.447956 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:43.447928    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:43.550724 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:43.550692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:54:59.483481 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:54:59.483377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:05.110978 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:05.110942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:05.166995 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:05.166950    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:05.266699 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:05.266666    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:05.365289 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:05.365189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:15.908060 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:15.908030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:16.741068 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:16.741036    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:22.429222 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:22.429170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:22.492134 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:22.492110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:22.565755 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:22.565732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:22.669866 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:22.669836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:22.765992 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:22.765929    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:23.526416 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:23.526373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:23.614143 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:23.614112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:23.713938 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:23.713912    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:33.834382 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:33.834353    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:33.938262 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:33.938230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:53.825016 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:53.824978    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:55:55.298977 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:55:55.298945    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:01.026546 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:01.026499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:06.682901 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:06.682870    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:06.752910 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:06.752858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:17.659278 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:17.659239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:37.313036 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:37.312943    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:43.708447 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:43.708379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:49.651020 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:49.650959    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:49.722823 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:49.722795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:49.949108 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:49.949010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:50.412792 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:50.412759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:50.518989 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:50.518956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:53.446987 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:53.446956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:53.571982 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:53.571952    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:53.725671 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:53.725592    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:53.858783 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:53.858761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:54.602031 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:54.601996    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:54.703492 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:54.703463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:58.040074 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:58.040037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:58.670111 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:58.670073    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:58.767184 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:58.767156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:56:59.107790 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:56:59.107759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:05.363216 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:05.363161    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:05.504077 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:05.504046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:05.853520 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:05.853487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:06.371989 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:06.371956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:06.711902 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:06.711831    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:12.406565 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:12.406535    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:12.630978 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:12.630948    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:12.760975 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:12.760882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:13.045946 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:13.045852    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:13.185787 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:13.185760    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:13.400528 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:13.400501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:19.831351 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:19.831318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:21.622823 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:21.622784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:26.586371 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:26.586339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:26.720090 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:26.720030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:33.717956 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:33.717920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:34.253438 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:34.253398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:34.447947 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:34.447913    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:37.511549 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:37.511516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:37.827226 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:37.827118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:38.076146 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:38.076110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:38.812856 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:38.812819    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:39.050737 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:39.050711    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:41.939537 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:41.939499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:55.807337 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.807299    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"]
Jul 09 17:57:55.807846 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.807816    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ef1ca6-60b7-4029-96e3-618d22161961" containerName="cleanup"
Jul 09 17:57:55.807846 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.807837    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ef1ca6-60b7-4029-96e3-618d22161961" containerName="cleanup"
Jul 09 17:57:55.807972 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.807938    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ef1ca6-60b7-4029-96e3-618d22161961" containerName="cleanup"
Jul 09 17:57:55.810955 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.810933    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:55.815400 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.815376    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-aaf858ec\"/\"kube-root-ca.crt\""
Jul 09 17:57:55.815400 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.815391    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-aaf858ec\"/\"openshift-service-ca.crt\""
Jul 09 17:57:55.817133 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.817114    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-aaf858ec\"/\"e2e-lifecycle-model-aaf858ec-kserve-self-signed-certs\""
Jul 09 17:57:55.817244 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.817188    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-aaf858ec\"/\"default-dockercfg-mfmc8\""
Jul 09 17:57:55.825080 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.825058    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"]
Jul 09 17:57:55.908401 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.908369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92464d6b-a4b4-4c6f-8858-b4392da696ad-tls-certs\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:55.908504 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.908414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-tmp-dir\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:55.908504 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.908436    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-dshm\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:55.908504 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.908497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-model-cache\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:55.908612 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.908572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5zv6\" (UniqueName: \"kubernetes.io/projected/92464d6b-a4b4-4c6f-8858-b4392da696ad-kube-api-access-m5zv6\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:55.908612 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.908595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-home\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:55.976910 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:55.976882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:57:56.009104 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.009083    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zv6\" (UniqueName: \"kubernetes.io/projected/92464d6b-a4b4-4c6f-8858-b4392da696ad-kube-api-access-m5zv6\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.009188 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.009114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-home\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.009188 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.009148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92464d6b-a4b4-4c6f-8858-b4392da696ad-tls-certs\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.009188 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.009173    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-tmp-dir\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.009358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.009219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-dshm\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.009358 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.009247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-model-cache\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.009546 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.009524    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-home\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.009586 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.009578    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-tmp-dir\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.009645 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.009623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-model-cache\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.011458 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.011438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-dshm\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.011578 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.011563    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92464d6b-a4b4-4c6f-8858-b4392da696ad-tls-certs\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.018301 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.018281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5zv6\" (UniqueName: \"kubernetes.io/projected/92464d6b-a4b4-4c6f-8858-b4392da696ad-kube-api-access-m5zv6\") pod \"e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") " pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.120903 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.120879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:57:56.255025 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.254996    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"]
Jul 09 17:57:56.256619 ip-10-0-129-85 kubenswrapper[2583]: W0709 17:57:56.256592    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92464d6b_a4b4_4c6f_8858_b4392da696ad.slice/crio-638f64bc8bc278455fdd1e1f15bac7d5b7a956973f836240f06b568db58118ca WatchSource:0}: Error finding container 638f64bc8bc278455fdd1e1f15bac7d5b7a956973f836240f06b568db58118ca: Status 404 returned error can't find the container with id 638f64bc8bc278455fdd1e1f15bac7d5b7a956973f836240f06b568db58118ca
Jul 09 17:57:56.597605 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.597572    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7" event={"ID":"92464d6b-a4b4-4c6f-8858-b4392da696ad","Type":"ContainerStarted","Data":"ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78"}
Jul 09 17:57:56.597784 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.597613    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7" event={"ID":"92464d6b-a4b4-4c6f-8858-b4392da696ad","Type":"ContainerStarted","Data":"638f64bc8bc278455fdd1e1f15bac7d5b7a956973f836240f06b568db58118ca"}
Jul 09 17:57:56.628443 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.628406    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7" podStartSLOduration=1.6283918179999999 podStartE2EDuration="1.628391818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:57:56.626421095 +0000 UTC m=+1800.409140427" watchObservedRunningTime="2026-07-09 17:57:56.628391818 +0000 UTC m=+1800.411111150"
Jul 09 17:57:56.719439 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.719418    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:57:56.722885 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:57:56.722866    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 17:58:06.121345 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:06.121296    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:58:06.121345 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:06.121355    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:58:06.133638 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:06.133615    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:58:06.660160 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:06.660130    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:58:30.015024 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:30.014961    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:30.444582 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:30.444538    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:36.160684 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:36.160650    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:41.138810 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:41.138771    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"]
Jul 09 17:58:41.191445 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:41.191414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:58:56.159115 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.159075    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7" podUID="92464d6b-a4b4-4c6f-8858-b4392da696ad" containerName="main" containerID="cri-o://ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78" gracePeriod=45
Jul 09 17:58:56.415171 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.415115    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:58:56.470774 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.470747    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-model-cache\") pod \"92464d6b-a4b4-4c6f-8858-b4392da696ad\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") "
Jul 09 17:58:56.470908 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.470790    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-dshm\") pod \"92464d6b-a4b4-4c6f-8858-b4392da696ad\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") "
Jul 09 17:58:56.470908 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.470818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5zv6\" (UniqueName: \"kubernetes.io/projected/92464d6b-a4b4-4c6f-8858-b4392da696ad-kube-api-access-m5zv6\") pod \"92464d6b-a4b4-4c6f-8858-b4392da696ad\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") "
Jul 09 17:58:56.470908 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.470864    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-tmp-dir\") pod \"92464d6b-a4b4-4c6f-8858-b4392da696ad\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") "
Jul 09 17:58:56.470908 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.470904    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-home\") pod \"92464d6b-a4b4-4c6f-8858-b4392da696ad\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") "
Jul 09 17:58:56.471127 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.470945    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92464d6b-a4b4-4c6f-8858-b4392da696ad-tls-certs\") pod \"92464d6b-a4b4-4c6f-8858-b4392da696ad\" (UID: \"92464d6b-a4b4-4c6f-8858-b4392da696ad\") "
Jul 09 17:58:56.471127 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.471027    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "92464d6b-a4b4-4c6f-8858-b4392da696ad" (UID: "92464d6b-a4b4-4c6f-8858-b4392da696ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:58:56.471268 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.471224    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92464d6b-a4b4-4c6f-8858-b4392da696ad" (UID: "92464d6b-a4b4-4c6f-8858-b4392da696ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:58:56.471268 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.471243    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:58:56.471379 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.471335    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-home" (OuterVolumeSpecName: "home") pod "92464d6b-a4b4-4c6f-8858-b4392da696ad" (UID: "92464d6b-a4b4-4c6f-8858-b4392da696ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:58:56.473032 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.473010    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-dshm" (OuterVolumeSpecName: "dshm") pod "92464d6b-a4b4-4c6f-8858-b4392da696ad" (UID: "92464d6b-a4b4-4c6f-8858-b4392da696ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 17:58:56.473123 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.473054    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92464d6b-a4b4-4c6f-8858-b4392da696ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "92464d6b-a4b4-4c6f-8858-b4392da696ad" (UID: "92464d6b-a4b4-4c6f-8858-b4392da696ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 17:58:56.473284 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.473265    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92464d6b-a4b4-4c6f-8858-b4392da696ad-kube-api-access-m5zv6" (OuterVolumeSpecName: "kube-api-access-m5zv6") pod "92464d6b-a4b4-4c6f-8858-b4392da696ad" (UID: "92464d6b-a4b4-4c6f-8858-b4392da696ad"). InnerVolumeSpecName "kube-api-access-m5zv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 17:58:56.572579 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.572553    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:58:56.572579 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.572577    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5zv6\" (UniqueName: \"kubernetes.io/projected/92464d6b-a4b4-4c6f-8858-b4392da696ad-kube-api-access-m5zv6\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:58:56.572746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.572593    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:58:56.572746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.572605    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92464d6b-a4b4-4c6f-8858-b4392da696ad-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:58:56.572746 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.572615    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92464d6b-a4b4-4c6f-8858-b4392da696ad-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 17:58:56.905841 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.905810    2583 generic.go:356] "Generic (PLEG): container finished" podID="92464d6b-a4b4-4c6f-8858-b4392da696ad" containerID="ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78" exitCode=0
Jul 09 17:58:56.905976 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.905868    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"
Jul 09 17:58:56.905976 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.905868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7" event={"ID":"92464d6b-a4b4-4c6f-8858-b4392da696ad","Type":"ContainerDied","Data":"ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78"}
Jul 09 17:58:56.905976 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.905976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7" event={"ID":"92464d6b-a4b4-4c6f-8858-b4392da696ad","Type":"ContainerDied","Data":"638f64bc8bc278455fdd1e1f15bac7d5b7a956973f836240f06b568db58118ca"}
Jul 09 17:58:56.906145 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.905993    2583 scope.go:117] "RemoveContainer" containerID="ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78"
Jul 09 17:58:56.913869 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.913852    2583 scope.go:117] "RemoveContainer" containerID="ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78"
Jul 09 17:58:56.914144 ip-10-0-129-85 kubenswrapper[2583]: E0709 17:58:56.914125    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78\": container with ID starting with ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78 not found: ID does not exist" containerID="ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78"
Jul 09 17:58:56.914248 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.914154    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78"} err="failed to get container status \"ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78\": rpc error: code = NotFound desc = could not find container \"ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78\": container with ID starting with ca6eccb67d0c78e0800d05df043cdfd13faa2f2371dea2f0fa58d08e5b68cd78 not found: ID does not exist"
Jul 09 17:58:56.926807 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.926784    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"]
Jul 09 17:58:56.933921 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:56.933873    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-aaf858ec/e2e-lifecycle-model-aaf858ec-kserve-88996bb67-zjzd7"]
Jul 09 17:58:58.670585 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:58.670542    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92464d6b-a4b4-4c6f-8858-b4392da696ad" path="/var/lib/kubelet/pods/92464d6b-a4b4-4c6f-8858-b4392da696ad/volumes"
Jul 09 17:58:59.943278 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:58:59.943251    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:00.483061 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:00.483026    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:06.360024 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:06.359985    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:21.048338 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:21.048262    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:21.163876 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:21.163845    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:21.575620 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:21.575586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:21.978290 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:21.978258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:23.548244 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:23.548189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:23.643875 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:23.643843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:23.740965 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:23.740941    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:24.708267 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:24.708235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:24.794137 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:24.794095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:24.894992 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:24.894964    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 17:59:56.330737 ip-10-0-129-85 kubenswrapper[2583]: I0709 17:59:56.330700    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:00.148177 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.148138    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"]
Jul 09 18:00:00.148570 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.148493    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92464d6b-a4b4-4c6f-8858-b4392da696ad" containerName="main"
Jul 09 18:00:00.148570 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.148505    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="92464d6b-a4b4-4c6f-8858-b4392da696ad" containerName="main"
Jul 09 18:00:00.148570 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.148565    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="92464d6b-a4b4-4c6f-8858-b4392da696ad" containerName="main"
Jul 09 18:00:00.151431 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.151415    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"
Jul 09 18:00:00.155186 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.155165    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 18:00:00.156511 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.156492    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 18:00:00.156511 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.156504    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5lf9x\""
Jul 09 18:00:00.170507 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.170475    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"]
Jul 09 18:00:00.249767 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.249737    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh6vh\" (UniqueName: \"kubernetes.io/projected/ed73df99-53fa-4e54-8d9e-4ef36d16c6a0-kube-api-access-jh6vh\") pod \"maas-api-key-cleanup-29727000-7kdg9\" (UID: \"ed73df99-53fa-4e54-8d9e-4ef36d16c6a0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"
Jul 09 18:00:00.351080 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.351052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh6vh\" (UniqueName: \"kubernetes.io/projected/ed73df99-53fa-4e54-8d9e-4ef36d16c6a0-kube-api-access-jh6vh\") pod \"maas-api-key-cleanup-29727000-7kdg9\" (UID: \"ed73df99-53fa-4e54-8d9e-4ef36d16c6a0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"
Jul 09 18:00:00.359976 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.359952    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh6vh\" (UniqueName: \"kubernetes.io/projected/ed73df99-53fa-4e54-8d9e-4ef36d16c6a0-kube-api-access-jh6vh\") pod \"maas-api-key-cleanup-29727000-7kdg9\" (UID: \"ed73df99-53fa-4e54-8d9e-4ef36d16c6a0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"
Jul 09 18:00:00.461310 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.461235    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"
Jul 09 18:00:00.591866 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:00.591840    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"]
Jul 09 18:00:00.593099 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:00:00.593074    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded73df99_53fa_4e54_8d9e_4ef36d16c6a0.slice/crio-c1544076f2fb1680169cc3cfa8ec2f95b8ec4a0dc4cda4f009833288e8a641e9 WatchSource:0}: Error finding container c1544076f2fb1680169cc3cfa8ec2f95b8ec4a0dc4cda4f009833288e8a641e9: Status 404 returned error can't find the container with id c1544076f2fb1680169cc3cfa8ec2f95b8ec4a0dc4cda4f009833288e8a641e9
Jul 09 18:00:01.247786 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:01.247745    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9" event={"ID":"ed73df99-53fa-4e54-8d9e-4ef36d16c6a0","Type":"ContainerStarted","Data":"c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c"}
Jul 09 18:00:01.248148 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:01.247796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9" event={"ID":"ed73df99-53fa-4e54-8d9e-4ef36d16c6a0","Type":"ContainerStarted","Data":"c1544076f2fb1680169cc3cfa8ec2f95b8ec4a0dc4cda4f009833288e8a641e9"}
Jul 09 18:00:01.265932 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:01.265886    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9" podStartSLOduration=1.265872326 podStartE2EDuration="1.265872326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:00:01.26477 +0000 UTC m=+1925.047489334" watchObservedRunningTime="2026-07-09 18:00:01.265872326 +0000 UTC m=+1925.048591656"
Jul 09 18:00:02.405345 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:02.405309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:08.207158 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:08.207130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:08.307556 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:08.307519    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:34.595182 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:34.595148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:34.693912 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:34.693884    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:38.877644 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:38.877616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:45.076326 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:45.076290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:50.915993 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:50.915922    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:51.015663 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:51.015632    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:00:51.150671 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:00:51.150643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:00.011915 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:00.011879    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"]
Jul 09 18:01:00.012332 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:00.012083    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9" podUID="ed73df99-53fa-4e54-8d9e-4ef36d16c6a0" containerName="cleanup" containerID="cri-o://c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c" gracePeriod=30
Jul 09 18:01:01.736713 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:01.736677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:02.119739 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:02.119708    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:23.173176 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:23.173121    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:29.149376 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:29.149321    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:29.265975 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:29.265927    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:29.531100 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:29.531000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:29.892465 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:29.892433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:30.144840 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.144776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:30.175657 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.175632    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"
Jul 09 18:01:30.241852 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.241826    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh6vh\" (UniqueName: \"kubernetes.io/projected/ed73df99-53fa-4e54-8d9e-4ef36d16c6a0-kube-api-access-jh6vh\") pod \"ed73df99-53fa-4e54-8d9e-4ef36d16c6a0\" (UID: \"ed73df99-53fa-4e54-8d9e-4ef36d16c6a0\") "
Jul 09 18:01:30.243737 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.243710    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed73df99-53fa-4e54-8d9e-4ef36d16c6a0-kube-api-access-jh6vh" (OuterVolumeSpecName: "kube-api-access-jh6vh") pod "ed73df99-53fa-4e54-8d9e-4ef36d16c6a0" (UID: "ed73df99-53fa-4e54-8d9e-4ef36d16c6a0"). InnerVolumeSpecName "kube-api-access-jh6vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:01:30.342603 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.342577    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh6vh\" (UniqueName: \"kubernetes.io/projected/ed73df99-53fa-4e54-8d9e-4ef36d16c6a0-kube-api-access-jh6vh\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:01:30.698536 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.698503    2583 generic.go:356] "Generic (PLEG): container finished" podID="ed73df99-53fa-4e54-8d9e-4ef36d16c6a0" containerID="c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c" exitCode=137
Jul 09 18:01:30.698653 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.698566    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"
Jul 09 18:01:30.698653 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.698562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9" event={"ID":"ed73df99-53fa-4e54-8d9e-4ef36d16c6a0","Type":"ContainerDied","Data":"c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c"}
Jul 09 18:01:30.698745 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.698675    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9" event={"ID":"ed73df99-53fa-4e54-8d9e-4ef36d16c6a0","Type":"ContainerDied","Data":"c1544076f2fb1680169cc3cfa8ec2f95b8ec4a0dc4cda4f009833288e8a641e9"}
Jul 09 18:01:30.698745 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.698697    2583 scope.go:117] "RemoveContainer" containerID="c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c"
Jul 09 18:01:30.707260 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.707245    2583 scope.go:117] "RemoveContainer" containerID="c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c"
Jul 09 18:01:30.707490 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:01:30.707474    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c\": container with ID starting with c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c not found: ID does not exist" containerID="c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c"
Jul 09 18:01:30.707551 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.707495    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c"} err="failed to get container status \"c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c\": rpc error: code = NotFound desc = could not find container \"c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c\": container with ID starting with c34a2364b7c18eb2393610a7efb66ee18f7b4122cf2daaa54e88e6d26b930d8c not found: ID does not exist"
Jul 09 18:01:30.724820 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.724796    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"]
Jul 09 18:01:30.738654 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:30.738630    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727000-7kdg9"]
Jul 09 18:01:32.670142 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:32.670110    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed73df99-53fa-4e54-8d9e-4ef36d16c6a0" path="/var/lib/kubelet/pods/ed73df99-53fa-4e54-8d9e-4ef36d16c6a0/volumes"
Jul 09 18:01:33.558949 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:33.558917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:33.700075 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:33.700031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:33.835363 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:33.835340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:33.979390 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:33.979363    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:34.392528 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:34.392501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:34.494593 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:34.494566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:38.047401 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:38.047364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:38.406700 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:38.406668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:38.880790 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:38.880766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:39.277862 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:39.277781    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:41.619667 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:41.619638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:41.795331 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:41.795301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:41.921268 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:41.921171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:42.156088 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:42.156055    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:42.699831 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:42.699801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:42.853106 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:42.853075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:46.048159 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:46.048130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:55.674530 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:55.674496    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:55.788500 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:55.788468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:57.717625 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.717593    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"]
Jul 09 18:01:57.717977 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.717914    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed73df99-53fa-4e54-8d9e-4ef36d16c6a0" containerName="cleanup"
Jul 09 18:01:57.717977 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.717926    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed73df99-53fa-4e54-8d9e-4ef36d16c6a0" containerName="cleanup"
Jul 09 18:01:57.718048 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.717983    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed73df99-53fa-4e54-8d9e-4ef36d16c6a0" containerName="cleanup"
Jul 09 18:01:57.722496 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.722480    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.725815 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.725798    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2fa6b6\"/\"test-model-2fa6b6-kserve-self-signed-certs\""
Jul 09 18:01:57.727329 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.727313    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2fa6b6\"/\"openshift-service-ca.crt\""
Jul 09 18:01:57.727565 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.727548    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2fa6b6\"/\"default-dockercfg-l9kp9\""
Jul 09 18:01:57.728920 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.728734    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2fa6b6\"/\"kube-root-ca.crt\""
Jul 09 18:01:57.740706 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.740687    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"]
Jul 09 18:01:57.752216 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.752179    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-model-cache\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.752332 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.752256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-home\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.752332 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.752284    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-dshm\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.752332 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.752308    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ee9733-c091-4232-bf61-9ac8a5abe47f-tls-certs\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.752494 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.752421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-tmp-dir\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.752494 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.752463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzqxs\" (UniqueName: \"kubernetes.io/projected/72ee9733-c091-4232-bf61-9ac8a5abe47f-kube-api-access-kzqxs\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.813063 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.813034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:01:57.853681 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.853649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-model-cache\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.853828 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.853690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-home\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.853828 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.853712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-dshm\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.853828 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.853733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ee9733-c091-4232-bf61-9ac8a5abe47f-tls-certs\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.853828 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.853806    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-tmp-dir\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.854035 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.853828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzqxs\" (UniqueName: \"kubernetes.io/projected/72ee9733-c091-4232-bf61-9ac8a5abe47f-kube-api-access-kzqxs\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.854109 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.854087    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-model-cache\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.854109 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.854099    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-home\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.854378 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.854360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-tmp-dir\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.855851 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.855822    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-dshm\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.856122 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.856102    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ee9733-c091-4232-bf61-9ac8a5abe47f-tls-certs\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:57.863542 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:57.863514    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzqxs\" (UniqueName: \"kubernetes.io/projected/72ee9733-c091-4232-bf61-9ac8a5abe47f-kube-api-access-kzqxs\") pod \"test-model-2fa6b6-kserve-fdb688cff-4x2sx\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") " pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:58.031862 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:58.031791    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:01:58.166926 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:58.166905    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"]
Jul 09 18:01:58.169132 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:01:58.169108    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72ee9733_c091_4232_bf61_9ac8a5abe47f.slice/crio-69ad8dda0e00cf65da038be5ef851542bfb068bafbdc067271883f3281c22104 WatchSource:0}: Error finding container 69ad8dda0e00cf65da038be5ef851542bfb068bafbdc067271883f3281c22104: Status 404 returned error can't find the container with id 69ad8dda0e00cf65da038be5ef851542bfb068bafbdc067271883f3281c22104
Jul 09 18:01:58.831348 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:58.831310    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx" event={"ID":"72ee9733-c091-4232-bf61-9ac8a5abe47f","Type":"ContainerStarted","Data":"52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0"}
Jul 09 18:01:58.831348 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:58.831353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx" event={"ID":"72ee9733-c091-4232-bf61-9ac8a5abe47f","Type":"ContainerStarted","Data":"69ad8dda0e00cf65da038be5ef851542bfb068bafbdc067271883f3281c22104"}
Jul 09 18:01:58.855280 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:01:58.855235    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx" podStartSLOduration=1.855219216 podStartE2EDuration="1.855219216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:01:58.853698862 +0000 UTC m=+2042.636418194" watchObservedRunningTime="2026-07-09 18:01:58.855219216 +0000 UTC m=+2042.637938541"
Jul 09 18:02:03.690254 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:03.690218    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:02:03.788723 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:03.788685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:02:08.032404 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:08.032365    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:02:08.032908 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:08.032442    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:02:08.044905 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:08.044882    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:02:08.890888 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:08.890859    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:02:48.897831 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:48.897792    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"]
Jul 09 18:02:48.901239 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:48.901222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:48.906215 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:48.906175    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-712c34\"/\"openshift-service-ca.crt\""
Jul 09 18:02:48.906215 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:48.906210    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-712c34\"/\"test-model-712c34-kserve-self-signed-certs\""
Jul 09 18:02:48.906387 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:48.906243    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-712c34\"/\"default-dockercfg-ggsxg\""
Jul 09 18:02:48.906734 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:48.906715    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-712c34\"/\"kube-root-ca.crt\""
Jul 09 18:02:48.913735 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:48.913715    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"]
Jul 09 18:02:48.969890 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:48.969867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:02:49.059952 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.059929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-home\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.060077 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.059957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-dshm\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.060077 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.059998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-tmp-dir\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.060077 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.060015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-model-cache\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.060232 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.060077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4a581a3-f71f-491e-a01e-5db86754267c-tls-certs\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.060232 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.060110    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hbpc\" (UniqueName: \"kubernetes.io/projected/c4a581a3-f71f-491e-a01e-5db86754267c-kube-api-access-6hbpc\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.160544 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.160485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-tmp-dir\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.160544 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.160517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-model-cache\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.160704 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.160547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4a581a3-f71f-491e-a01e-5db86754267c-tls-certs\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.160704 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.160573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hbpc\" (UniqueName: \"kubernetes.io/projected/c4a581a3-f71f-491e-a01e-5db86754267c-kube-api-access-6hbpc\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.160704 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.160623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-home\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.160704 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.160642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-dshm\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.160939 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.160914    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-tmp-dir\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.161002 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.160962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-model-cache\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.161041 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.160998    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-home\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.162742 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.162722    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-dshm\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.163143 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.163123    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4a581a3-f71f-491e-a01e-5db86754267c-tls-certs\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.169950 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.169923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hbpc\" (UniqueName: \"kubernetes.io/projected/c4a581a3-f71f-491e-a01e-5db86754267c-kube-api-access-6hbpc\") pod \"test-model-712c34-kserve-6cbf8f5db5-8d54q\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") " pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.211160 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.211141    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:49.343750 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:49.343725    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"]
Jul 09 18:02:49.345466 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:02:49.345442    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4a581a3_f71f_491e_a01e_5db86754267c.slice/crio-6e69739b317f83e45d268f04f9c7629b7d89a317ab1d1bc8b59ad6529a84486c WatchSource:0}: Error finding container 6e69739b317f83e45d268f04f9c7629b7d89a317ab1d1bc8b59ad6529a84486c: Status 404 returned error can't find the container with id 6e69739b317f83e45d268f04f9c7629b7d89a317ab1d1bc8b59ad6529a84486c
Jul 09 18:02:50.090819 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:50.090788    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q" event={"ID":"c4a581a3-f71f-491e-a01e-5db86754267c","Type":"ContainerStarted","Data":"590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4"}
Jul 09 18:02:50.090819 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:50.090826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q" event={"ID":"c4a581a3-f71f-491e-a01e-5db86754267c","Type":"ContainerStarted","Data":"6e69739b317f83e45d268f04f9c7629b7d89a317ab1d1bc8b59ad6529a84486c"}
Jul 09 18:02:50.115116 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:50.115072    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q" podStartSLOduration=2.115059029 podStartE2EDuration="2.115059029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:02:50.11351646 +0000 UTC m=+2093.896235793" watchObservedRunningTime="2026-07-09 18:02:50.115059029 +0000 UTC m=+2093.897778391"
Jul 09 18:02:56.751429 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:56.751401    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 18:02:56.756831 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:56.756810    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 18:02:59.211640 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:59.211606    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:59.212086 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:59.211657    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:02:59.223991 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:02:59.223968    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:03:00.154556 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:00.154526    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:03:10.080668 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:10.080632    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:10.729510 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:10.729466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:10.801500 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:10.801473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:11.514738 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:11.514702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:13.907705 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:13.907632    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:14.007377 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:14.007347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:14.119157 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:14.119124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:14.348373 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:14.348346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:14.715978 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:14.715872    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:14.810153 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:14.810124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:18.464539 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:18.464506    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:22.882173 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.882139    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"]
Jul 09 18:03:22.885536 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.885518    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:22.888656 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.888634    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"openshift-service-ca.crt\""
Jul 09 18:03:22.890252 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.890232    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"kube-root-ca.crt\""
Jul 09 18:03:22.890378 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.890356    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"default-dockercfg-wkdgh\""
Jul 09 18:03:22.890378 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.890367    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"test-model-27f074-kserve-self-signed-certs\""
Jul 09 18:03:22.894272 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.894240    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"]
Jul 09 18:03:22.908517 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.908492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:22.915608 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.915587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-dshm\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:22.915710 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.915626    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4psg\" (UniqueName: \"kubernetes.io/projected/8c08dff1-4038-4c37-a00b-5347e8b38e28-kube-api-access-d4psg\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:22.915710 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.915698    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-model-cache\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:22.915860 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.915766    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-tmp-dir\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:22.915860 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.915793    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c08dff1-4038-4c37-a00b-5347e8b38e28-tls-certs\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:22.915944 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:22.915868    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-home\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.017022 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.016998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-home\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.017114 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.017048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-dshm\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.017114 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.017076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4psg\" (UniqueName: \"kubernetes.io/projected/8c08dff1-4038-4c37-a00b-5347e8b38e28-kube-api-access-d4psg\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.017194 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.017123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-model-cache\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.017194 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.017165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-tmp-dir\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.017315 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.017194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c08dff1-4038-4c37-a00b-5347e8b38e28-tls-certs\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.017491 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.017470    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-home\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.017561 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.017518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-model-cache\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.017615 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.017566    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-tmp-dir\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.019321 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.019298    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-dshm\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.019622 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.019604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c08dff1-4038-4c37-a00b-5347e8b38e28-tls-certs\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.025702 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.025682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4psg\" (UniqueName: \"kubernetes.io/projected/8c08dff1-4038-4c37-a00b-5347e8b38e28-kube-api-access-d4psg\") pod \"test-model-27f074-kserve-6447686d49-wmznf\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.195333 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.195274    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:23.324989 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:23.324967    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"]
Jul 09 18:03:23.326216 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:03:23.326170    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c08dff1_4038_4c37_a00b_5347e8b38e28.slice/crio-532396df55bb2e8325b50c91d054c4ed416b46b9a4ee2a655fe638b8e28eba2a WatchSource:0}: Error finding container 532396df55bb2e8325b50c91d054c4ed416b46b9a4ee2a655fe638b8e28eba2a: Status 404 returned error can't find the container with id 532396df55bb2e8325b50c91d054c4ed416b46b9a4ee2a655fe638b8e28eba2a
Jul 09 18:03:24.268238 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:24.268177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf" event={"ID":"8c08dff1-4038-4c37-a00b-5347e8b38e28","Type":"ContainerStarted","Data":"a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599"}
Jul 09 18:03:24.268608 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:24.268248    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf" event={"ID":"8c08dff1-4038-4c37-a00b-5347e8b38e28","Type":"ContainerStarted","Data":"532396df55bb2e8325b50c91d054c4ed416b46b9a4ee2a655fe638b8e28eba2a"}
Jul 09 18:03:24.288016 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:24.287971    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf" podStartSLOduration=2.2879529290000002 podStartE2EDuration="2.287952929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:03:24.287387879 +0000 UTC m=+2128.070107210" watchObservedRunningTime="2026-07-09 18:03:24.287952929 +0000 UTC m=+2128.070672259"
Jul 09 18:03:33.196296 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:33.196264    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:33.196688 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:33.196466    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:33.208768 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:33.208743    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:33.324737 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:33.324703    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:03:39.334355 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:39.334311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:39.764567 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:39.764461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:39.857554 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:39.857521    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:41.052414 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:41.052381    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:42.836624 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:42.836593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:44.742605 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:44.742570    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"]
Jul 09 18:03:44.801866 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:44.801832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:03:59.763082 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:03:59.762986    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf" podUID="8c08dff1-4038-4c37-a00b-5347e8b38e28" containerName="main" containerID="cri-o://a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599" gracePeriod=45
Jul 09 18:04:00.012963 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.012934    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:04:00.133078 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.133048    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c08dff1-4038-4c37-a00b-5347e8b38e28-tls-certs\") pod \"8c08dff1-4038-4c37-a00b-5347e8b38e28\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") "
Jul 09 18:04:00.133255 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.133107    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-home\") pod \"8c08dff1-4038-4c37-a00b-5347e8b38e28\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") "
Jul 09 18:04:00.133255 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.133128    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-model-cache\") pod \"8c08dff1-4038-4c37-a00b-5347e8b38e28\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") "
Jul 09 18:04:00.133255 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.133176    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4psg\" (UniqueName: \"kubernetes.io/projected/8c08dff1-4038-4c37-a00b-5347e8b38e28-kube-api-access-d4psg\") pod \"8c08dff1-4038-4c37-a00b-5347e8b38e28\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") "
Jul 09 18:04:00.133255 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.133230    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-dshm\") pod \"8c08dff1-4038-4c37-a00b-5347e8b38e28\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") "
Jul 09 18:04:00.133255 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.133253    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-tmp-dir\") pod \"8c08dff1-4038-4c37-a00b-5347e8b38e28\" (UID: \"8c08dff1-4038-4c37-a00b-5347e8b38e28\") "
Jul 09 18:04:00.133479 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.133453    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-home" (OuterVolumeSpecName: "home") pod "8c08dff1-4038-4c37-a00b-5347e8b38e28" (UID: "8c08dff1-4038-4c37-a00b-5347e8b38e28"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:04:00.133479 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.133464    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c08dff1-4038-4c37-a00b-5347e8b38e28" (UID: "8c08dff1-4038-4c37-a00b-5347e8b38e28"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:04:00.133637 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.133613    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c08dff1-4038-4c37-a00b-5347e8b38e28" (UID: "8c08dff1-4038-4c37-a00b-5347e8b38e28"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:04:00.135274 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.135250    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-dshm" (OuterVolumeSpecName: "dshm") pod "8c08dff1-4038-4c37-a00b-5347e8b38e28" (UID: "8c08dff1-4038-4c37-a00b-5347e8b38e28"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:04:00.135394 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.135369    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c08dff1-4038-4c37-a00b-5347e8b38e28-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c08dff1-4038-4c37-a00b-5347e8b38e28" (UID: "8c08dff1-4038-4c37-a00b-5347e8b38e28"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:04:00.135450 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.135395    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c08dff1-4038-4c37-a00b-5347e8b38e28-kube-api-access-d4psg" (OuterVolumeSpecName: "kube-api-access-d4psg") pod "8c08dff1-4038-4c37-a00b-5347e8b38e28" (UID: "8c08dff1-4038-4c37-a00b-5347e8b38e28"). InnerVolumeSpecName "kube-api-access-d4psg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:04:00.234009 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.233987    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:04:00.234009 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.234008    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:04:00.234163 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.234029    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c08dff1-4038-4c37-a00b-5347e8b38e28-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:04:00.234163 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.234038    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:04:00.234163 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.234047    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c08dff1-4038-4c37-a00b-5347e8b38e28-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:04:00.234163 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.234055    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4psg\" (UniqueName: \"kubernetes.io/projected/8c08dff1-4038-4c37-a00b-5347e8b38e28-kube-api-access-d4psg\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:04:00.472672 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.472583    2583 generic.go:356] "Generic (PLEG): container finished" podID="8c08dff1-4038-4c37-a00b-5347e8b38e28" containerID="a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599" exitCode=0
Jul 09 18:04:00.472672 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.472640    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"
Jul 09 18:04:00.472895 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.472664    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf" event={"ID":"8c08dff1-4038-4c37-a00b-5347e8b38e28","Type":"ContainerDied","Data":"a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599"}
Jul 09 18:04:00.472895 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.472723    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf" event={"ID":"8c08dff1-4038-4c37-a00b-5347e8b38e28","Type":"ContainerDied","Data":"532396df55bb2e8325b50c91d054c4ed416b46b9a4ee2a655fe638b8e28eba2a"}
Jul 09 18:04:00.472895 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.472745    2583 scope.go:117] "RemoveContainer" containerID="a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599"
Jul 09 18:04:00.481952 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.481935    2583 scope.go:117] "RemoveContainer" containerID="a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599"
Jul 09 18:04:00.482237 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:04:00.482219    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599\": container with ID starting with a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599 not found: ID does not exist" containerID="a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599"
Jul 09 18:04:00.482313 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.482242    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599"} err="failed to get container status \"a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599\": rpc error: code = NotFound desc = could not find container \"a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599\": container with ID starting with a11470be11c309da6ebcfc0b08d1f160d18f30a66f25470e0470237817d10599 not found: ID does not exist"
Jul 09 18:04:00.497431 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.497403    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"]
Jul 09 18:04:00.502516 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.502496    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-wmznf"]
Jul 09 18:04:00.669636 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:00.669611    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c08dff1-4038-4c37-a00b-5347e8b38e28" path="/var/lib/kubelet/pods/8c08dff1-4038-4c37-a00b-5347e8b38e28/volumes"
Jul 09 18:04:30.650080 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:30.650043    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:30.979362 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:30.979284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:36.565460 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:36.565429    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:36.664994 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:36.664942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:36.843517 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:36.843491    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:37.082490 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:37.082458    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:37.485908 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:37.485880    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:37.834550 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:37.834517    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:38.401586 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:38.401551    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:39.916149 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:39.916112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:40.029837 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:40.029802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:40.129558 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:40.129524    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:40.238528 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:40.238448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:44.627221 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:44.627158    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:56.303212 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.303167    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"]
Jul 09 18:04:56.303597 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.303583    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c08dff1-4038-4c37-a00b-5347e8b38e28" containerName="main"
Jul 09 18:04:56.303651 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.303599    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c08dff1-4038-4c37-a00b-5347e8b38e28" containerName="main"
Jul 09 18:04:56.303696 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.303670    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c08dff1-4038-4c37-a00b-5347e8b38e28" containerName="main"
Jul 09 18:04:56.306713 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.306696    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.313051 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.312870    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"test-model-27f074-kserve-self-signed-certs\""
Jul 09 18:04:56.313051 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.312890    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"kube-root-ca.crt\""
Jul 09 18:04:56.313051 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.312890    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"default-dockercfg-rbmsn\""
Jul 09 18:04:56.313286 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.313132    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"openshift-service-ca.crt\""
Jul 09 18:04:56.325633 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.325608    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"]
Jul 09 18:04:56.425401 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.425356    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:04:56.470688 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.470661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-model-cache\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.470803 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.470690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tmp-dir\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.470803 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.470710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-dshm\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.470803 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.470761    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-home\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.470980 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.470865    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tls-certs\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.470980 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.470910    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml2rw\" (UniqueName: \"kubernetes.io/projected/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-kube-api-access-ml2rw\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.571841 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.571775    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tls-certs\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.571841 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.571804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml2rw\" (UniqueName: \"kubernetes.io/projected/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-kube-api-access-ml2rw\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.572023 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.571864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-model-cache\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.572023 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.571880    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tmp-dir\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.572023 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.571896    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-dshm\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.572023 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.571919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-home\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.572306 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.572287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tmp-dir\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.572388 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.572346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-home\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.572441 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.572384    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-model-cache\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.573992 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.573970    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-dshm\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.575957 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.575941    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"test-model-27f074-kserve-self-signed-certs\""
Jul 09 18:04:56.582163 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.582143    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"kube-root-ca.crt\""
Jul 09 18:04:56.584057 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.584035    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tls-certs\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.592577 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.592559    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"openshift-service-ca.crt\""
Jul 09 18:04:56.602698 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.602676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml2rw\" (UniqueName: \"kubernetes.io/projected/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-kube-api-access-ml2rw\") pod \"test-model-27f074-kserve-6447686d49-h54vc\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") " pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.618561 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.618537    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-27f074\"/\"default-dockercfg-rbmsn\""
Jul 09 18:04:56.626083 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.626070    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:04:56.759100 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:56.759077    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"]
Jul 09 18:04:56.760417 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:04:56.760390    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21ce728e_6836_4755_ba04_7c2bf0a4b1d0.slice/crio-b4aff0e913b82c9e81393f6217fb524b5de0a562dc532147e32ae6edabbd0db4 WatchSource:0}: Error finding container b4aff0e913b82c9e81393f6217fb524b5de0a562dc532147e32ae6edabbd0db4: Status 404 returned error can't find the container with id b4aff0e913b82c9e81393f6217fb524b5de0a562dc532147e32ae6edabbd0db4
Jul 09 18:04:57.763633 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:57.763598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc" event={"ID":"21ce728e-6836-4755-ba04-7c2bf0a4b1d0","Type":"ContainerStarted","Data":"264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512"}
Jul 09 18:04:57.763633 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:57.763637    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc" event={"ID":"21ce728e-6836-4755-ba04-7c2bf0a4b1d0","Type":"ContainerStarted","Data":"b4aff0e913b82c9e81393f6217fb524b5de0a562dc532147e32ae6edabbd0db4"}
Jul 09 18:04:57.783634 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:04:57.783587    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc" podStartSLOduration=1.7835733070000002 podStartE2EDuration="1.783573307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:57.781571133 +0000 UTC m=+2221.564290464" watchObservedRunningTime="2026-07-09 18:04:57.783573307 +0000 UTC m=+2221.566292684"
Jul 09 18:05:03.294055 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:03.294012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:03.396287 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:03.396254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:06.626700 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:06.626661    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:05:06.627229 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:06.626722    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:05:06.639321 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:06.639296    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:05:06.820023 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:06.820001    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:05:26.543058 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:26.542977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:26.611258 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:26.611231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:26.920734 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:26.920707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:31.933020 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:31.932972    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"]
Jul 09 18:05:31.977106 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:31.977075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:35.317873 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:35.317835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:35.418723 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:35.418688    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:05:46.954836 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:46.954781    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc" podUID="21ce728e-6836-4755-ba04-7c2bf0a4b1d0" containerName="main" containerID="cri-o://264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512" gracePeriod=45
Jul 09 18:05:47.199394 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.199369    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:05:47.267279 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267207    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml2rw\" (UniqueName: \"kubernetes.io/projected/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-kube-api-access-ml2rw\") pod \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") "
Jul 09 18:05:47.267279 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267253    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-dshm\") pod \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") "
Jul 09 18:05:47.267596 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267354    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tmp-dir\") pod \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") "
Jul 09 18:05:47.267596 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267393    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tls-certs\") pod \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") "
Jul 09 18:05:47.267596 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267418    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-home\") pod \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") "
Jul 09 18:05:47.267596 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267446    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-model-cache\") pod \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\" (UID: \"21ce728e-6836-4755-ba04-7c2bf0a4b1d0\") "
Jul 09 18:05:47.267792 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267598    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "21ce728e-6836-4755-ba04-7c2bf0a4b1d0" (UID: "21ce728e-6836-4755-ba04-7c2bf0a4b1d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:05:47.267792 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267711    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-home" (OuterVolumeSpecName: "home") pod "21ce728e-6836-4755-ba04-7c2bf0a4b1d0" (UID: "21ce728e-6836-4755-ba04-7c2bf0a4b1d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:05:47.267792 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267749    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "21ce728e-6836-4755-ba04-7c2bf0a4b1d0" (UID: "21ce728e-6836-4755-ba04-7c2bf0a4b1d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:05:47.267792 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267790    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:05:47.267933 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.267806    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:05:47.269325 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.269303    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-kube-api-access-ml2rw" (OuterVolumeSpecName: "kube-api-access-ml2rw") pod "21ce728e-6836-4755-ba04-7c2bf0a4b1d0" (UID: "21ce728e-6836-4755-ba04-7c2bf0a4b1d0"). InnerVolumeSpecName "kube-api-access-ml2rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:05:47.269444 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.269426    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-dshm" (OuterVolumeSpecName: "dshm") pod "21ce728e-6836-4755-ba04-7c2bf0a4b1d0" (UID: "21ce728e-6836-4755-ba04-7c2bf0a4b1d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:05:47.269552 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.269527    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "21ce728e-6836-4755-ba04-7c2bf0a4b1d0" (UID: "21ce728e-6836-4755-ba04-7c2bf0a4b1d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:05:47.369135 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.369096    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:05:47.369135 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.369129    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:05:47.369345 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.369142    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml2rw\" (UniqueName: \"kubernetes.io/projected/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-kube-api-access-ml2rw\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:05:47.369345 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:47.369156    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ce728e-6836-4755-ba04-7c2bf0a4b1d0-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:05:48.026645 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.026612    2583 generic.go:356] "Generic (PLEG): container finished" podID="21ce728e-6836-4755-ba04-7c2bf0a4b1d0" containerID="264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512" exitCode=0
Jul 09 18:05:48.027053 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.026652    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"
Jul 09 18:05:48.027053 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.026698    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc" event={"ID":"21ce728e-6836-4755-ba04-7c2bf0a4b1d0","Type":"ContainerDied","Data":"264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512"}
Jul 09 18:05:48.027053 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.026741    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc" event={"ID":"21ce728e-6836-4755-ba04-7c2bf0a4b1d0","Type":"ContainerDied","Data":"b4aff0e913b82c9e81393f6217fb524b5de0a562dc532147e32ae6edabbd0db4"}
Jul 09 18:05:48.027053 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.026758    2583 scope.go:117] "RemoveContainer" containerID="264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512"
Jul 09 18:05:48.036732 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.036716    2583 scope.go:117] "RemoveContainer" containerID="264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512"
Jul 09 18:05:48.037003 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:05:48.036987    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512\": container with ID starting with 264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512 not found: ID does not exist" containerID="264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512"
Jul 09 18:05:48.037064 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.037012    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512"} err="failed to get container status \"264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512\": rpc error: code = NotFound desc = could not find container \"264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512\": container with ID starting with 264537b29176e18f08b4909e87d9e40360935bfadab30bfa88c7689cb564b512 not found: ID does not exist"
Jul 09 18:05:48.050112 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.050086    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"]
Jul 09 18:05:48.053260 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.053236    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-27f074/test-model-27f074-kserve-6447686d49-h54vc"]
Jul 09 18:05:48.670411 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:05:48.670383    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21ce728e-6836-4755-ba04-7c2bf0a4b1d0" path="/var/lib/kubelet/pods/21ce728e-6836-4755-ba04-7c2bf0a4b1d0/volumes"
Jul 09 18:06:08.881584 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:08.881543    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:09.402966 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:09.402936    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:15.186838 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:15.186804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:24.010411 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:24.010371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:29.419421 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:29.419382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:29.484367 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:29.484333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:29.710494 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:29.710414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:29.988701 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:29.988620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:30.859183 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:30.859149    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"]
Jul 09 18:06:30.881146 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:30.881117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:31.790135 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:31.790104    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"]
Jul 09 18:06:31.811858 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:31.811826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:32.165405 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:32.165372    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:32.545931 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:32.545823    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:32.724868 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:32.724837    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:32.823641 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:32.823540    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:32.980117 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:32.980086    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:37.605401 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:37.605350    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:45.879358 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:45.879292    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx" podUID="72ee9733-c091-4232-bf61-9ac8a5abe47f" containerName="main" containerID="cri-o://52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0" gracePeriod=45
Jul 09 18:06:46.121933 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.121910    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:06:46.237635 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.237569    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ee9733-c091-4232-bf61-9ac8a5abe47f-tls-certs\") pod \"72ee9733-c091-4232-bf61-9ac8a5abe47f\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") "
Jul 09 18:06:46.237635 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.237603    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-model-cache\") pod \"72ee9733-c091-4232-bf61-9ac8a5abe47f\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") "
Jul 09 18:06:46.237635 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.237619    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-tmp-dir\") pod \"72ee9733-c091-4232-bf61-9ac8a5abe47f\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") "
Jul 09 18:06:46.237861 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.237702    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzqxs\" (UniqueName: \"kubernetes.io/projected/72ee9733-c091-4232-bf61-9ac8a5abe47f-kube-api-access-kzqxs\") pod \"72ee9733-c091-4232-bf61-9ac8a5abe47f\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") "
Jul 09 18:06:46.237861 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.237764    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-dshm\") pod \"72ee9733-c091-4232-bf61-9ac8a5abe47f\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") "
Jul 09 18:06:46.237861 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.237804    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-home\") pod \"72ee9733-c091-4232-bf61-9ac8a5abe47f\" (UID: \"72ee9733-c091-4232-bf61-9ac8a5abe47f\") "
Jul 09 18:06:46.238014 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.237911    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-model-cache" (OuterVolumeSpecName: "model-cache") pod "72ee9733-c091-4232-bf61-9ac8a5abe47f" (UID: "72ee9733-c091-4232-bf61-9ac8a5abe47f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:06:46.238074 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.238003    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "72ee9733-c091-4232-bf61-9ac8a5abe47f" (UID: "72ee9733-c091-4232-bf61-9ac8a5abe47f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:06:46.238124 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.238083    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:46.238124 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.238101    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:46.238244 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.238175    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-home" (OuterVolumeSpecName: "home") pod "72ee9733-c091-4232-bf61-9ac8a5abe47f" (UID: "72ee9733-c091-4232-bf61-9ac8a5abe47f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:06:46.239929 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.239893    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ee9733-c091-4232-bf61-9ac8a5abe47f-kube-api-access-kzqxs" (OuterVolumeSpecName: "kube-api-access-kzqxs") pod "72ee9733-c091-4232-bf61-9ac8a5abe47f" (UID: "72ee9733-c091-4232-bf61-9ac8a5abe47f"). InnerVolumeSpecName "kube-api-access-kzqxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:06:46.239929 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.239903    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-dshm" (OuterVolumeSpecName: "dshm") pod "72ee9733-c091-4232-bf61-9ac8a5abe47f" (UID: "72ee9733-c091-4232-bf61-9ac8a5abe47f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:06:46.240074 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.239933    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72ee9733-c091-4232-bf61-9ac8a5abe47f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "72ee9733-c091-4232-bf61-9ac8a5abe47f" (UID: "72ee9733-c091-4232-bf61-9ac8a5abe47f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:06:46.325525 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.325496    2583 generic.go:356] "Generic (PLEG): container finished" podID="72ee9733-c091-4232-bf61-9ac8a5abe47f" containerID="52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0" exitCode=0
Jul 09 18:06:46.325626 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.325537    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"
Jul 09 18:06:46.325626 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.325584    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx" event={"ID":"72ee9733-c091-4232-bf61-9ac8a5abe47f","Type":"ContainerDied","Data":"52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0"}
Jul 09 18:06:46.325626 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.325624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx" event={"ID":"72ee9733-c091-4232-bf61-9ac8a5abe47f","Type":"ContainerDied","Data":"69ad8dda0e00cf65da038be5ef851542bfb068bafbdc067271883f3281c22104"}
Jul 09 18:06:46.325764 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.325640    2583 scope.go:117] "RemoveContainer" containerID="52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0"
Jul 09 18:06:46.334408 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.334391    2583 scope.go:117] "RemoveContainer" containerID="52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0"
Jul 09 18:06:46.334623 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:06:46.334604    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0\": container with ID starting with 52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0 not found: ID does not exist" containerID="52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0"
Jul 09 18:06:46.334665 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.334631    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0"} err="failed to get container status \"52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0\": rpc error: code = NotFound desc = could not find container \"52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0\": container with ID starting with 52684b78783519315887e3889f9c876d371439c64b3d455bdf55b568575a58f0 not found: ID does not exist"
Jul 09 18:06:46.338478 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.338463    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzqxs\" (UniqueName: \"kubernetes.io/projected/72ee9733-c091-4232-bf61-9ac8a5abe47f-kube-api-access-kzqxs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:46.338549 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.338481    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:46.338549 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.338489    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72ee9733-c091-4232-bf61-9ac8a5abe47f-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:46.338549 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.338497    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72ee9733-c091-4232-bf61-9ac8a5abe47f-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:46.347602 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.347576    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"]
Jul 09 18:06:46.349589 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.349572    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2fa6b6/test-model-2fa6b6-kserve-fdb688cff-4x2sx"]
Jul 09 18:06:46.670070 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.670047    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72ee9733-c091-4232-bf61-9ac8a5abe47f" path="/var/lib/kubelet/pods/72ee9733-c091-4232-bf61-9ac8a5abe47f/volumes"
Jul 09 18:06:46.810102 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:46.810069    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q" podUID="c4a581a3-f71f-491e-a01e-5db86754267c" containerName="main" containerID="cri-o://590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4" gracePeriod=45
Jul 09 18:06:47.056337 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.056313    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:06:47.146410 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146382    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-dshm\") pod \"c4a581a3-f71f-491e-a01e-5db86754267c\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") "
Jul 09 18:06:47.146546 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-model-cache\") pod \"c4a581a3-f71f-491e-a01e-5db86754267c\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") "
Jul 09 18:06:47.146546 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146445    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-tmp-dir\") pod \"c4a581a3-f71f-491e-a01e-5db86754267c\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") "
Jul 09 18:06:47.146546 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146468    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4a581a3-f71f-491e-a01e-5db86754267c-tls-certs\") pod \"c4a581a3-f71f-491e-a01e-5db86754267c\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") "
Jul 09 18:06:47.146546 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146513    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-home\") pod \"c4a581a3-f71f-491e-a01e-5db86754267c\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") "
Jul 09 18:06:47.146763 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146563    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hbpc\" (UniqueName: \"kubernetes.io/projected/c4a581a3-f71f-491e-a01e-5db86754267c-kube-api-access-6hbpc\") pod \"c4a581a3-f71f-491e-a01e-5db86754267c\" (UID: \"c4a581a3-f71f-491e-a01e-5db86754267c\") "
Jul 09 18:06:47.146763 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146697    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4a581a3-f71f-491e-a01e-5db86754267c" (UID: "c4a581a3-f71f-491e-a01e-5db86754267c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:06:47.146763 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146709    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4a581a3-f71f-491e-a01e-5db86754267c" (UID: "c4a581a3-f71f-491e-a01e-5db86754267c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:06:47.146921 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146776    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-home" (OuterVolumeSpecName: "home") pod "c4a581a3-f71f-491e-a01e-5db86754267c" (UID: "c4a581a3-f71f-491e-a01e-5db86754267c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:06:47.146921 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146865    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:47.146921 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146878    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:47.146921 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.146889    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:47.148723 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.148695    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a581a3-f71f-491e-a01e-5db86754267c-kube-api-access-6hbpc" (OuterVolumeSpecName: "kube-api-access-6hbpc") pod "c4a581a3-f71f-491e-a01e-5db86754267c" (UID: "c4a581a3-f71f-491e-a01e-5db86754267c"). InnerVolumeSpecName "kube-api-access-6hbpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:06:47.148836 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.148731    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-dshm" (OuterVolumeSpecName: "dshm") pod "c4a581a3-f71f-491e-a01e-5db86754267c" (UID: "c4a581a3-f71f-491e-a01e-5db86754267c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:06:47.148836 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.148744    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a581a3-f71f-491e-a01e-5db86754267c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4a581a3-f71f-491e-a01e-5db86754267c" (UID: "c4a581a3-f71f-491e-a01e-5db86754267c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:06:47.247453 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.247385    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4a581a3-f71f-491e-a01e-5db86754267c-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:47.247453 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.247414    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4a581a3-f71f-491e-a01e-5db86754267c-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:47.247453 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.247425    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hbpc\" (UniqueName: \"kubernetes.io/projected/c4a581a3-f71f-491e-a01e-5db86754267c-kube-api-access-6hbpc\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:06:47.332052 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.332022    2583 generic.go:356] "Generic (PLEG): container finished" podID="c4a581a3-f71f-491e-a01e-5db86754267c" containerID="590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4" exitCode=0
Jul 09 18:06:47.332178 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.332063    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"
Jul 09 18:06:47.332178 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.332072    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q" event={"ID":"c4a581a3-f71f-491e-a01e-5db86754267c","Type":"ContainerDied","Data":"590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4"}
Jul 09 18:06:47.332178 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.332113    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q" event={"ID":"c4a581a3-f71f-491e-a01e-5db86754267c","Type":"ContainerDied","Data":"6e69739b317f83e45d268f04f9c7629b7d89a317ab1d1bc8b59ad6529a84486c"}
Jul 09 18:06:47.332178 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.332133    2583 scope.go:117] "RemoveContainer" containerID="590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4"
Jul 09 18:06:47.340943 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.340928    2583 scope.go:117] "RemoveContainer" containerID="590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4"
Jul 09 18:06:47.341190 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:06:47.341170    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4\": container with ID starting with 590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4 not found: ID does not exist" containerID="590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4"
Jul 09 18:06:47.341290 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.341209    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4"} err="failed to get container status \"590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4\": rpc error: code = NotFound desc = could not find container \"590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4\": container with ID starting with 590a1a6690d59271d1d53d10617e80e07ea6387fd5c3bc139ed44b1983a33ab4 not found: ID does not exist"
Jul 09 18:06:47.353941 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.353915    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"]
Jul 09 18:06:47.361985 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:47.361965    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-712c34/test-model-712c34-kserve-6cbf8f5db5-8d54q"]
Jul 09 18:06:48.670665 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:48.670591    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4a581a3-f71f-491e-a01e-5db86754267c" path="/var/lib/kubelet/pods/c4a581a3-f71f-491e-a01e-5db86754267c/volumes"
Jul 09 18:06:57.586378 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:57.586332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:06:57.686998 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:06:57.686965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:04.478245 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:04.478195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:04.580978 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:04.580947    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:14.311797 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:14.311765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:14.591519 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:14.591480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:14.825129 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:14.825094    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:14.997625 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:14.997545    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:15.384728 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:15.384686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:15.483237 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:15.483187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:21.434325 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:21.434294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:21.493385 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:21.493352    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:21.694388 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:21.694310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:21.922588 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:21.922554    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:22.298865 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:22.298830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:22.633085 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:22.633051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:23.014270 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:23.014176    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:25.138818 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:25.138784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:25.235020 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:25.234987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:25.339318 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:25.339288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:25.628166 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:25.628134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:25.729902 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:25.729871    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:25.828891 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:25.828856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:29.694428 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:29.694392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:30.171735 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:30.171703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:30.483751 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:30.483664    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:30.886738 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:30.886704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:33.180929 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:33.180899    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:33.276996 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:33.276963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:33.372495 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:33.372462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:33.603963 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:33.603928    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:34.016751 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:34.016667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:34.116746 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:34.116720    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:37.934052 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:37.934020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:45.989333 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:45.989300    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:46.375679 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:46.370716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:46.467107 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:46.467071    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:46.574138 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:46.574100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:46.664138 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:46.664063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:52.328487 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:52.328454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:54.067678 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:54.067636    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:56.058288 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:56.058250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:56.163610 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:56.163580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:07:56.784522 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:56.784501    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 18:07:56.791145 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:07:56.791123    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 18:08:02.823590 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:02.823552    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:03.191501 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:03.191463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:03.844433 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:03.844395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:03.947062 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:03.947037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:09.739643 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:09.739601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:09.839647 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:09.839619    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:10.008858 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:10.008781    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:10.262378 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:10.262298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:10.616541 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:10.616504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:10.929112 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:10.929023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:11.111875 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:11.111841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:13.536076 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:13.536041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:13.774861 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:13.774812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:13.868905 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:13.868879    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:14.090153 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:14.090120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:14.242319 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:14.242236    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:14.337634 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:14.337602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:18.012323 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:18.012290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:18.346039 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:18.346008    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:18.768930 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:18.768828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:18.865598 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:18.865572    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:21.502892 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:21.502856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:21.613146 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:21.613119    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:21.710084 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:21.710055    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:22.024971 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:22.024923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:22.179085 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:22.179052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:22.280166 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:22.280091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:26.030550 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:26.030510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:35.305788 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:35.305757    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:35.404641 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:35.404601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:44.197892 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:44.197859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:44.297857 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:44.297824    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:49.388563 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.388527    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"]
Jul 09 18:08:49.389030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.388880    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ee9733-c091-4232-bf61-9ac8a5abe47f" containerName="main"
Jul 09 18:08:49.389030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.388893    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ee9733-c091-4232-bf61-9ac8a5abe47f" containerName="main"
Jul 09 18:08:49.389030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.388905    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ce728e-6836-4755-ba04-7c2bf0a4b1d0" containerName="main"
Jul 09 18:08:49.389030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.388910    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ce728e-6836-4755-ba04-7c2bf0a4b1d0" containerName="main"
Jul 09 18:08:49.389030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.388932    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a581a3-f71f-491e-a01e-5db86754267c" containerName="main"
Jul 09 18:08:49.389030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.388937    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a581a3-f71f-491e-a01e-5db86754267c" containerName="main"
Jul 09 18:08:49.389030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.388986    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="72ee9733-c091-4232-bf61-9ac8a5abe47f" containerName="main"
Jul 09 18:08:49.389030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.388994    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="21ce728e-6836-4755-ba04-7c2bf0a4b1d0" containerName="main"
Jul 09 18:08:49.389030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.389001    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a581a3-f71f-491e-a01e-5db86754267c" containerName="main"
Jul 09 18:08:49.391974 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.391955    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.395480 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.395456    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-09d279\"/\"default-dockercfg-w9nfn\""
Jul 09 18:08:49.396536 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.396506    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-09d279\"/\"kube-root-ca.crt\""
Jul 09 18:08:49.396754 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.396721    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-09d279\"/\"openshift-service-ca.crt\""
Jul 09 18:08:49.396949 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.396733    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-09d279\"/\"auth-test-model-09d279-kserve-self-signed-certs\""
Jul 09 18:08:49.405425 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.405406    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"]
Jul 09 18:08:49.431314 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.431279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:49.569476 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.569446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tls-certs\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.569632 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.569496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-home\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.569632 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.569516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-model-cache\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.569632 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.569596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-dshm\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.569810 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.569638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7xfz\" (UniqueName: \"kubernetes.io/projected/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-kube-api-access-h7xfz\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.569810 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.569713    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tmp-dir\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.670972 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.670888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tmp-dir\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.670972 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.670937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tls-certs\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.670972 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.670970    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-home\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.671239 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.670986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-model-cache\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.671239 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.671015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-dshm\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.671239 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.671050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7xfz\" (UniqueName: \"kubernetes.io/projected/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-kube-api-access-h7xfz\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.671403 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.671371    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tmp-dir\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.671403 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.671383    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-home\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.671502 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.671419    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-model-cache\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.673365 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.673341    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-dshm\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.673606 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.673589    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tls-certs\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.680240 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.680218    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7xfz\" (UniqueName: \"kubernetes.io/projected/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-kube-api-access-h7xfz\") pod \"auth-test-model-09d279-kserve-794764955f-7gtvn\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") " pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.704159 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.704134    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:49.833605 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.833578    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"]
Jul 09 18:08:49.836526 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:08:49.836498    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7dad2f64_e6f1_48b8_90bb_60fd34b22b1b.slice/crio-27c5b65413dcd0f6798d66d998c3aa56483b3da60b2b5ff68c1b7ff215e514b8 WatchSource:0}: Error finding container 27c5b65413dcd0f6798d66d998c3aa56483b3da60b2b5ff68c1b7ff215e514b8: Status 404 returned error can't find the container with id 27c5b65413dcd0f6798d66d998c3aa56483b3da60b2b5ff68c1b7ff215e514b8
Jul 09 18:08:49.942488 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.942419    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn" event={"ID":"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b","Type":"ContainerStarted","Data":"ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7"}
Jul 09 18:08:49.942488 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.942461    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn" event={"ID":"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b","Type":"ContainerStarted","Data":"27c5b65413dcd0f6798d66d998c3aa56483b3da60b2b5ff68c1b7ff215e514b8"}
Jul 09 18:08:49.961832 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:49.961783    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn" podStartSLOduration=0.961771392 podStartE2EDuration="961.771392ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:08:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:08:49.96073126 +0000 UTC m=+2453.743450591" watchObservedRunningTime="2026-07-09 18:08:49.961771392 +0000 UTC m=+2453.744490723"
Jul 09 18:08:56.100694 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:56.100654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:08:59.704501 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:59.704462    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:59.704907 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:59.704513    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:08:59.717085 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:08:59.717052    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:09:00.006874 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:00.006787    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:09:07.198285 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:07.198245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:09:26.598797 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.598759    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"]
Jul 09 18:09:26.602308 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.602285    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.605734 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.605697    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"kube-root-ca.crt\""
Jul 09 18:09:26.607103 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.607080    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"default-dockercfg-5pms8\""
Jul 09 18:09:26.607229 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.607214    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"auth-test-model-e0b9f9-kserve-self-signed-certs\""
Jul 09 18:09:26.607520 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.607086    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"openshift-service-ca.crt\""
Jul 09 18:09:26.610680 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.610659    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"]
Jul 09 18:09:26.625371 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.625345    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:09:26.641378 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.641351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae63896-f069-404a-a064-0a7be02c008f-tls-certs\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.641471 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.641395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-home\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.641471 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.641424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhlvc\" (UniqueName: \"kubernetes.io/projected/0ae63896-f069-404a-a064-0a7be02c008f-kube-api-access-jhlvc\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.641593 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.641507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-dshm\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.641593 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.641544    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-tmp-dir\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.641593 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.641578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-model-cache\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.742566 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.742538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-dshm\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.742661 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.742571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-tmp-dir\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.742661 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.742589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-model-cache\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.742773 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.742750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae63896-f069-404a-a064-0a7be02c008f-tls-certs\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.742830 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.742799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-home\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.742882 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.742830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhlvc\" (UniqueName: \"kubernetes.io/projected/0ae63896-f069-404a-a064-0a7be02c008f-kube-api-access-jhlvc\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.742882 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.742872    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-tmp-dir\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.743048 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.743018    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-model-cache\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.743172 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.743159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-home\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.744817 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.744798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-dshm\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.745234 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.745193    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae63896-f069-404a-a064-0a7be02c008f-tls-certs\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.751787 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.751757    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhlvc\" (UniqueName: \"kubernetes.io/projected/0ae63896-f069-404a-a064-0a7be02c008f-kube-api-access-jhlvc\") pod \"auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") " pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:26.913459 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:26.913405    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:27.042765 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:27.042734    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"]
Jul 09 18:09:27.044240 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:09:27.044193    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ae63896_f069_404a_a064_0a7be02c008f.slice/crio-c76d980b28b9ddba2583a3f86416ea341af4ac33f14b425d2edcb2c269ae6a1d WatchSource:0}: Error finding container c76d980b28b9ddba2583a3f86416ea341af4ac33f14b425d2edcb2c269ae6a1d: Status 404 returned error can't find the container with id c76d980b28b9ddba2583a3f86416ea341af4ac33f14b425d2edcb2c269ae6a1d
Jul 09 18:09:27.131640 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:27.131602    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d" event={"ID":"0ae63896-f069-404a-a064-0a7be02c008f","Type":"ContainerStarted","Data":"5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7"}
Jul 09 18:09:27.131789 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:27.131651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d" event={"ID":"0ae63896-f069-404a-a064-0a7be02c008f","Type":"ContainerStarted","Data":"c76d980b28b9ddba2583a3f86416ea341af4ac33f14b425d2edcb2c269ae6a1d"}
Jul 09 18:09:27.151066 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:27.151017    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d" podStartSLOduration=1.151001031 podStartE2EDuration="1.151001031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:09:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:09:27.149244009 +0000 UTC m=+2490.931963340" watchObservedRunningTime="2026-07-09 18:09:27.151001031 +0000 UTC m=+2490.933720362"
Jul 09 18:09:36.914025 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:36.913987    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:36.914450 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:36.914038    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:36.926325 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:36.926298    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:09:37.196427 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:09:37.196356    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:10:33.282989 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:10:33.282958    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:10:36.788075 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:10:36.788041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:10:36.889194 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:10:36.889166    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:11:31.360670 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:31.360599    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"]
Jul 09 18:11:31.380044 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:31.380017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:11:32.192360 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:32.192328    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"]
Jul 09 18:11:32.209854 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:32.209827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:11:46.380637 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.380574    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn" podUID="7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" containerName="main" containerID="cri-o://ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7" gracePeriod=45
Jul 09 18:11:46.631213 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.631145    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:11:46.733682 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.733658    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tmp-dir\") pod \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") "
Jul 09 18:11:46.733824 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.733694    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-home\") pod \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") "
Jul 09 18:11:46.733824 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.733720    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-model-cache\") pod \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") "
Jul 09 18:11:46.733824 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.733741    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-dshm\") pod \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") "
Jul 09 18:11:46.733824 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.733785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7xfz\" (UniqueName: \"kubernetes.io/projected/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-kube-api-access-h7xfz\") pod \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") "
Jul 09 18:11:46.734041 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.733890    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tls-certs\") pod \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\" (UID: \"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b\") "
Jul 09 18:11:46.734041 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.733962    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-model-cache" (OuterVolumeSpecName: "model-cache") pod "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" (UID: "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:46.734041 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.733977    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-home" (OuterVolumeSpecName: "home") pod "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" (UID: "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:46.734041 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.733989    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" (UID: "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:46.734271 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.734195    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:46.734271 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.734242    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:46.734271 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.734257    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:46.735978 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.735947    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" (UID: "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:11:46.736096 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.735985    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-dshm" (OuterVolumeSpecName: "dshm") pod "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" (UID: "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:46.736096 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.736026    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-kube-api-access-h7xfz" (OuterVolumeSpecName: "kube-api-access-h7xfz") pod "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" (UID: "7dad2f64-e6f1-48b8-90bb-60fd34b22b1b"). InnerVolumeSpecName "kube-api-access-h7xfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:11:46.835489 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.835466    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:46.835489 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.835485    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:46.835628 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.835494    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7xfz\" (UniqueName: \"kubernetes.io/projected/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b-kube-api-access-h7xfz\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:46.853888 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.853859    2583 generic.go:356] "Generic (PLEG): container finished" podID="7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" containerID="ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7" exitCode=0
Jul 09 18:11:46.853985 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.853895    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn" event={"ID":"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b","Type":"ContainerDied","Data":"ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7"}
Jul 09 18:11:46.853985 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.853935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn" event={"ID":"7dad2f64-e6f1-48b8-90bb-60fd34b22b1b","Type":"ContainerDied","Data":"27c5b65413dcd0f6798d66d998c3aa56483b3da60b2b5ff68c1b7ff215e514b8"}
Jul 09 18:11:46.853985 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.853951    2583 scope.go:117] "RemoveContainer" containerID="ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7"
Jul 09 18:11:46.853985 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.853903    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"
Jul 09 18:11:46.862673 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.862648    2583 scope.go:117] "RemoveContainer" containerID="ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7"
Jul 09 18:11:46.862914 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:11:46.862898    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7\": container with ID starting with ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7 not found: ID does not exist" containerID="ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7"
Jul 09 18:11:46.862957 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.862922    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7"} err="failed to get container status \"ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7\": rpc error: code = NotFound desc = could not find container \"ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7\": container with ID starting with ea4bb985bcdb5bf4972e06df48ad919f7093fcfd77503711518158ad0240ced7 not found: ID does not exist"
Jul 09 18:11:46.876420 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.876397    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"]
Jul 09 18:11:46.880484 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:46.880465    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/auth-test-model-09d279-kserve-794764955f-7gtvn"]
Jul 09 18:11:47.212956 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.212925    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d" podUID="0ae63896-f069-404a-a064-0a7be02c008f" containerName="main" containerID="cri-o://5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7" gracePeriod=45
Jul 09 18:11:47.451848 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.451825    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:11:47.541037 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.540979    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-home\") pod \"0ae63896-f069-404a-a064-0a7be02c008f\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") "
Jul 09 18:11:47.541139 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.541046    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-dshm\") pod \"0ae63896-f069-404a-a064-0a7be02c008f\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") "
Jul 09 18:11:47.541139 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.541105    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhlvc\" (UniqueName: \"kubernetes.io/projected/0ae63896-f069-404a-a064-0a7be02c008f-kube-api-access-jhlvc\") pod \"0ae63896-f069-404a-a064-0a7be02c008f\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") "
Jul 09 18:11:47.541243 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.541178    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-model-cache\") pod \"0ae63896-f069-404a-a064-0a7be02c008f\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") "
Jul 09 18:11:47.541243 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.541231    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae63896-f069-404a-a064-0a7be02c008f-tls-certs\") pod \"0ae63896-f069-404a-a064-0a7be02c008f\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") "
Jul 09 18:11:47.541362 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.541266    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-tmp-dir\") pod \"0ae63896-f069-404a-a064-0a7be02c008f\" (UID: \"0ae63896-f069-404a-a064-0a7be02c008f\") "
Jul 09 18:11:47.541362 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.541279    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-home" (OuterVolumeSpecName: "home") pod "0ae63896-f069-404a-a064-0a7be02c008f" (UID: "0ae63896-f069-404a-a064-0a7be02c008f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:47.541517 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.541495    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ae63896-f069-404a-a064-0a7be02c008f" (UID: "0ae63896-f069-404a-a064-0a7be02c008f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:47.541572 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.541514    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:47.541572 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.541542    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ae63896-f069-404a-a064-0a7be02c008f" (UID: "0ae63896-f069-404a-a064-0a7be02c008f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:47.543109 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.543086    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-dshm" (OuterVolumeSpecName: "dshm") pod "0ae63896-f069-404a-a064-0a7be02c008f" (UID: "0ae63896-f069-404a-a064-0a7be02c008f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:11:47.543223 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.543180    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae63896-f069-404a-a064-0a7be02c008f-kube-api-access-jhlvc" (OuterVolumeSpecName: "kube-api-access-jhlvc") pod "0ae63896-f069-404a-a064-0a7be02c008f" (UID: "0ae63896-f069-404a-a064-0a7be02c008f"). InnerVolumeSpecName "kube-api-access-jhlvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:11:47.543376 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.543352    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ae63896-f069-404a-a064-0a7be02c008f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ae63896-f069-404a-a064-0a7be02c008f" (UID: "0ae63896-f069-404a-a064-0a7be02c008f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:11:47.641866 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.641846    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhlvc\" (UniqueName: \"kubernetes.io/projected/0ae63896-f069-404a-a064-0a7be02c008f-kube-api-access-jhlvc\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:47.641866 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.641866    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:47.642012 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.641877    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ae63896-f069-404a-a064-0a7be02c008f-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:47.642012 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.641885    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:47.642012 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.641892    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ae63896-f069-404a-a064-0a7be02c008f-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:11:47.860587 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.860554    2583 generic.go:356] "Generic (PLEG): container finished" podID="0ae63896-f069-404a-a064-0a7be02c008f" containerID="5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7" exitCode=0
Jul 09 18:11:47.860736 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.860601    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"
Jul 09 18:11:47.860736 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.860624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d" event={"ID":"0ae63896-f069-404a-a064-0a7be02c008f","Type":"ContainerDied","Data":"5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7"}
Jul 09 18:11:47.860736 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.860660    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d" event={"ID":"0ae63896-f069-404a-a064-0a7be02c008f","Type":"ContainerDied","Data":"c76d980b28b9ddba2583a3f86416ea341af4ac33f14b425d2edcb2c269ae6a1d"}
Jul 09 18:11:47.860736 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.860679    2583 scope.go:117] "RemoveContainer" containerID="5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7"
Jul 09 18:11:47.869840 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.869824    2583 scope.go:117] "RemoveContainer" containerID="5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7"
Jul 09 18:11:47.870064 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:11:47.870047    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7\": container with ID starting with 5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7 not found: ID does not exist" containerID="5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7"
Jul 09 18:11:47.870114 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.870071    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7"} err="failed to get container status \"5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7\": rpc error: code = NotFound desc = could not find container \"5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7\": container with ID starting with 5aeffc045207cfbad90521878fc773a4ab9d2e0d1272faa968a871c20cea2ba7 not found: ID does not exist"
Jul 09 18:11:47.885032 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.885007    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"]
Jul 09 18:11:47.890159 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:47.890139    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/auth-test-model-e0b9f9-kserve-65d8d4c66c-zzz7d"]
Jul 09 18:11:48.297086 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.297023    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"]
Jul 09 18:11:48.297365 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.297352    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" containerName="main"
Jul 09 18:11:48.297421 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.297366    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" containerName="main"
Jul 09 18:11:48.297421 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.297389    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae63896-f069-404a-a064-0a7be02c008f" containerName="main"
Jul 09 18:11:48.297421 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.297395    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae63896-f069-404a-a064-0a7be02c008f" containerName="main"
Jul 09 18:11:48.297523 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.297448    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" containerName="main"
Jul 09 18:11:48.297523 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.297459    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae63896-f069-404a-a064-0a7be02c008f" containerName="main"
Jul 09 18:11:48.301616 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.301600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.304764 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.304741    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-09d279\"/\"openshift-service-ca.crt\""
Jul 09 18:11:48.306268 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.306247    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-09d279\"/\"sub-test-model-09d279-kserve-self-signed-certs\""
Jul 09 18:11:48.306377 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.306247    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-09d279\"/\"default-dockercfg-w9nfn\""
Jul 09 18:11:48.306377 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.306257    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-09d279\"/\"kube-root-ca.crt\""
Jul 09 18:11:48.312680 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.312657    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"]
Jul 09 18:11:48.348067 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.348042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-home\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.348225 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.348071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-dshm\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.348225 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.348087    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-model-cache\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.348225 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.348106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tmp-dir\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.348394 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.348221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tls-certs\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.348394 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.348280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dffdf\" (UniqueName: \"kubernetes.io/projected/d25f7a63-f8bd-43a4-9cff-68a42f632da6-kube-api-access-dffdf\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.374774 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.374748    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:11:48.449530 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.449466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tls-certs\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.449650 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.449557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dffdf\" (UniqueName: \"kubernetes.io/projected/d25f7a63-f8bd-43a4-9cff-68a42f632da6-kube-api-access-dffdf\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.449845 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.449824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-home\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.449922 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.449854    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-dshm\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.449922 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.449870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-model-cache\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.449922 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.449888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tmp-dir\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.450247 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.450224    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-home\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.450311 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.450278    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-model-cache\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.450361 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.450334    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tmp-dir\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.452084 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.452062    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-dshm\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.452422 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.452260    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tls-certs\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.458754 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.458733    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dffdf\" (UniqueName: \"kubernetes.io/projected/d25f7a63-f8bd-43a4-9cff-68a42f632da6-kube-api-access-dffdf\") pod \"sub-test-model-09d279-kserve-c9d7d69fc-v7824\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") " pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.617964 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.617940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:48.672603 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.672568    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ae63896-f069-404a-a064-0a7be02c008f" path="/var/lib/kubelet/pods/0ae63896-f069-404a-a064-0a7be02c008f/volumes"
Jul 09 18:11:48.673653 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.673148    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dad2f64-e6f1-48b8-90bb-60fd34b22b1b" path="/var/lib/kubelet/pods/7dad2f64-e6f1-48b8-90bb-60fd34b22b1b/volumes"
Jul 09 18:11:48.748892 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.748867    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"]
Jul 09 18:11:48.750081 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:11:48.750056    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd25f7a63_f8bd_43a4_9cff_68a42f632da6.slice/crio-cdd8e6a41739b7fc0330f5536e0400b3e8a7c1809c6a3ee85a4cdcfe6cdbaf16 WatchSource:0}: Error finding container cdd8e6a41739b7fc0330f5536e0400b3e8a7c1809c6a3ee85a4cdcfe6cdbaf16: Status 404 returned error can't find the container with id cdd8e6a41739b7fc0330f5536e0400b3e8a7c1809c6a3ee85a4cdcfe6cdbaf16
Jul 09 18:11:48.867291 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.867259    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824" event={"ID":"d25f7a63-f8bd-43a4-9cff-68a42f632da6","Type":"ContainerStarted","Data":"f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32"}
Jul 09 18:11:48.867471 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.867302    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824" event={"ID":"d25f7a63-f8bd-43a4-9cff-68a42f632da6","Type":"ContainerStarted","Data":"cdd8e6a41739b7fc0330f5536e0400b3e8a7c1809c6a3ee85a4cdcfe6cdbaf16"}
Jul 09 18:11:48.885841 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:48.885763    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824" podStartSLOduration=0.885749694 podStartE2EDuration="885.749694ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:11:48.885337604 +0000 UTC m=+2632.668056932" watchObservedRunningTime="2026-07-09 18:11:48.885749694 +0000 UTC m=+2632.668469025"
Jul 09 18:11:58.618816 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:58.618779    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:58.618816 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:58.618823    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:58.631692 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:58.631664    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:11:58.938256 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:11:58.938164    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:12:11.186046 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.186009    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"]
Jul 09 18:12:11.189417 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.189400    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.194032 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.194005    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"kube-root-ca.crt\""
Jul 09 18:12:11.194251 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.194233    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"default-dockercfg-5pms8\""
Jul 09 18:12:11.194376 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.194269    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"sub-test-model-e0b9f9-kserve-self-signed-certs\""
Jul 09 18:12:11.194376 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.194273    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"openshift-service-ca.crt\""
Jul 09 18:12:11.199827 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.199803    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"]
Jul 09 18:12:11.268716 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.268691    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:12:11.330978 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.330952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-dshm\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.331159 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.330984    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tmp-dir\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.331159 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.331004    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-home\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.331159 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.331027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdccs\" (UniqueName: \"kubernetes.io/projected/9bf967f2-6c35-4e08-92be-08a02b6d58fb-kube-api-access-pdccs\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.331159 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.331124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tls-certs\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.331374 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.331183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-model-cache\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.431586 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.431555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-model-cache\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.431699 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.431633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-dshm\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.431699 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.431660    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tmp-dir\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.431699 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.431682    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-home\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.431876 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.431715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdccs\" (UniqueName: \"kubernetes.io/projected/9bf967f2-6c35-4e08-92be-08a02b6d58fb-kube-api-access-pdccs\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.431876 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.431762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tls-certs\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.431980 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.431963    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-model-cache\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.432037 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.431986    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tmp-dir\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.432095 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.432048    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-home\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.433951 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.433929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-dshm\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.434161 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.434141    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tls-certs\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.440026 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.439976    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdccs\" (UniqueName: \"kubernetes.io/projected/9bf967f2-6c35-4e08-92be-08a02b6d58fb-kube-api-access-pdccs\") pod \"sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") " pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.498845 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.498826    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:11.628525 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.628500    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"]
Jul 09 18:12:11.629851 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:12:11.629817    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bf967f2_6c35_4e08_92be_08a02b6d58fb.slice/crio-b2cbf904fe651293c20613abc27966c8e00ed35e2f66d2188e092b4b4d59a749 WatchSource:0}: Error finding container b2cbf904fe651293c20613abc27966c8e00ed35e2f66d2188e092b4b4d59a749: Status 404 returned error can't find the container with id b2cbf904fe651293c20613abc27966c8e00ed35e2f66d2188e092b4b4d59a749
Jul 09 18:12:11.994128 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.994093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6" event={"ID":"9bf967f2-6c35-4e08-92be-08a02b6d58fb","Type":"ContainerStarted","Data":"a2364e6bc5e1c8bf603a3562ff222dc54e4a9cf928a0a162031ea3eae15d674b"}
Jul 09 18:12:11.994326 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:11.994140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6" event={"ID":"9bf967f2-6c35-4e08-92be-08a02b6d58fb","Type":"ContainerStarted","Data":"b2cbf904fe651293c20613abc27966c8e00ed35e2f66d2188e092b4b4d59a749"}
Jul 09 18:12:12.013360 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:12.013316    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6" podStartSLOduration=1.013302139 podStartE2EDuration="1.013302139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:12:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:12:12.010856442 +0000 UTC m=+2655.793575770" watchObservedRunningTime="2026-07-09 18:12:12.013302139 +0000 UTC m=+2655.796021469"
Jul 09 18:12:21.499385 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:21.499348    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:21.499385 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:21.499398    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:21.511917 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:21.511890    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:22.055061 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:22.055032    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:12:54.927275 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:54.927235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:12:56.820240 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:56.820191    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 18:12:56.833869 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:12:56.833847    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qcpcg_4557981e-bf4c-4cc2-9cf9-12fa46137668/ovn-acl-logging/0.log"
Jul 09 18:13:00.281536 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:00.281502    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"]
Jul 09 18:13:00.292404 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:00.292377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:01.130557 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:01.130525    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"]
Jul 09 18:13:01.135421 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:01.135392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:09.446841 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:09.446807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:10.004621 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.004587    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"]
Jul 09 18:13:10.008333 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.008315    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.012538 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.012516    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-09d279\"/\"rate-test-model-09d279-kserve-self-signed-certs\""
Jul 09 18:13:10.014417 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.014336    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"]
Jul 09 18:13:10.040261 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.040239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:10.093435 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.093403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-tmp-dir\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.093527 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.093446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-home\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.093527 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.093470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dpmn\" (UniqueName: \"kubernetes.io/projected/076a62ac-128d-46b8-9b35-b7d12590720f-kube-api-access-8dpmn\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.093527 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.093507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-model-cache\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.093651 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.093558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-dshm\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.093651 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.093575    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/076a62ac-128d-46b8-9b35-b7d12590720f-tls-certs\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.194684 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.194651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-home\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.194684 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.194683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dpmn\" (UniqueName: \"kubernetes.io/projected/076a62ac-128d-46b8-9b35-b7d12590720f-kube-api-access-8dpmn\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.194857 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.194705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-model-cache\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.194857 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.194752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-dshm\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.194857 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.194769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/076a62ac-128d-46b8-9b35-b7d12590720f-tls-certs\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.194857 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.194827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-tmp-dir\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.195115 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.195095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-home\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.195182 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.195166    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-tmp-dir\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.195281 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.195181    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-model-cache\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.197041 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.197021    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-dshm\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.197280 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.197263    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/076a62ac-128d-46b8-9b35-b7d12590720f-tls-certs\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.204102 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.204082    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dpmn\" (UniqueName: \"kubernetes.io/projected/076a62ac-128d-46b8-9b35-b7d12590720f-kube-api-access-8dpmn\") pod \"rate-test-model-09d279-kserve-5b64f5464c-9zmjb\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") " pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.319577 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.319502    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:10.455864 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:10.455839    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"]
Jul 09 18:13:10.458430 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:13:10.458401    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod076a62ac_128d_46b8_9b35_b7d12590720f.slice/crio-a01cc42226cec111cf519b5da5663c08427f55457446d565b17706a460ceeb0f WatchSource:0}: Error finding container a01cc42226cec111cf519b5da5663c08427f55457446d565b17706a460ceeb0f: Status 404 returned error can't find the container with id a01cc42226cec111cf519b5da5663c08427f55457446d565b17706a460ceeb0f
Jul 09 18:13:11.299406 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:11.299369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb" event={"ID":"076a62ac-128d-46b8-9b35-b7d12590720f","Type":"ContainerStarted","Data":"1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a"}
Jul 09 18:13:11.299614 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:11.299414    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb" event={"ID":"076a62ac-128d-46b8-9b35-b7d12590720f","Type":"ContainerStarted","Data":"a01cc42226cec111cf519b5da5663c08427f55457446d565b17706a460ceeb0f"}
Jul 09 18:13:11.323469 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:11.323423    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb" podStartSLOduration=2.323409018 podStartE2EDuration="2.323409018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:13:11.32198244 +0000 UTC m=+2715.104701770" watchObservedRunningTime="2026-07-09 18:13:11.323409018 +0000 UTC m=+2715.106128349"
Jul 09 18:13:15.302276 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.302215    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824" podUID="d25f7a63-f8bd-43a4-9cff-68a42f632da6" containerName="main" containerID="cri-o://f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32" gracePeriod=45
Jul 09 18:13:15.553265 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.553211    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:13:15.741991 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.741966    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tmp-dir\") pod \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") "
Jul 09 18:13:15.742137 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.742050    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tls-certs\") pod \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") "
Jul 09 18:13:15.742137 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.742073    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-home\") pod \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") "
Jul 09 18:13:15.742137 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.742098    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-dshm\") pod \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") "
Jul 09 18:13:15.742137 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.742129    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dffdf\" (UniqueName: \"kubernetes.io/projected/d25f7a63-f8bd-43a4-9cff-68a42f632da6-kube-api-access-dffdf\") pod \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") "
Jul 09 18:13:15.742339 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.742171    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-model-cache\") pod \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\" (UID: \"d25f7a63-f8bd-43a4-9cff-68a42f632da6\") "
Jul 09 18:13:15.742339 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.742219    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d25f7a63-f8bd-43a4-9cff-68a42f632da6" (UID: "d25f7a63-f8bd-43a4-9cff-68a42f632da6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:13:15.742433 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.742392    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-home" (OuterVolumeSpecName: "home") pod "d25f7a63-f8bd-43a4-9cff-68a42f632da6" (UID: "d25f7a63-f8bd-43a4-9cff-68a42f632da6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:13:15.742472 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.742444    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:15.742551 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.742528    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-model-cache" (OuterVolumeSpecName: "model-cache") pod "d25f7a63-f8bd-43a4-9cff-68a42f632da6" (UID: "d25f7a63-f8bd-43a4-9cff-68a42f632da6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:13:15.744281 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.744256    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d25f7a63-f8bd-43a4-9cff-68a42f632da6" (UID: "d25f7a63-f8bd-43a4-9cff-68a42f632da6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:13:15.744353 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.744257    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-dshm" (OuterVolumeSpecName: "dshm") pod "d25f7a63-f8bd-43a4-9cff-68a42f632da6" (UID: "d25f7a63-f8bd-43a4-9cff-68a42f632da6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:13:15.744353 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.744324    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25f7a63-f8bd-43a4-9cff-68a42f632da6-kube-api-access-dffdf" (OuterVolumeSpecName: "kube-api-access-dffdf") pod "d25f7a63-f8bd-43a4-9cff-68a42f632da6" (UID: "d25f7a63-f8bd-43a4-9cff-68a42f632da6"). InnerVolumeSpecName "kube-api-access-dffdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:13:15.843421 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.843397    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d25f7a63-f8bd-43a4-9cff-68a42f632da6-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:15.843421 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.843420    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:15.843572 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.843429    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:15.843572 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.843438    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dffdf\" (UniqueName: \"kubernetes.io/projected/d25f7a63-f8bd-43a4-9cff-68a42f632da6-kube-api-access-dffdf\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:15.843572 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:15.843446    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d25f7a63-f8bd-43a4-9cff-68a42f632da6-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:16.151128 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.151024    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6" podUID="9bf967f2-6c35-4e08-92be-08a02b6d58fb" containerName="main" containerID="cri-o://a2364e6bc5e1c8bf603a3562ff222dc54e4a9cf928a0a162031ea3eae15d674b" gracePeriod=45
Jul 09 18:13:16.327334 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.327304    2583 generic.go:356] "Generic (PLEG): container finished" podID="d25f7a63-f8bd-43a4-9cff-68a42f632da6" containerID="f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32" exitCode=0
Jul 09 18:13:16.327748 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.327348    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"
Jul 09 18:13:16.327748 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.327392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824" event={"ID":"d25f7a63-f8bd-43a4-9cff-68a42f632da6","Type":"ContainerDied","Data":"f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32"}
Jul 09 18:13:16.327748 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.327441    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824" event={"ID":"d25f7a63-f8bd-43a4-9cff-68a42f632da6","Type":"ContainerDied","Data":"cdd8e6a41739b7fc0330f5536e0400b3e8a7c1809c6a3ee85a4cdcfe6cdbaf16"}
Jul 09 18:13:16.327748 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.327466    2583 scope.go:117] "RemoveContainer" containerID="f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32"
Jul 09 18:13:16.329402 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.329374    2583 generic.go:356] "Generic (PLEG): container finished" podID="9bf967f2-6c35-4e08-92be-08a02b6d58fb" containerID="a2364e6bc5e1c8bf603a3562ff222dc54e4a9cf928a0a162031ea3eae15d674b" exitCode=0
Jul 09 18:13:16.329515 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.329456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6" event={"ID":"9bf967f2-6c35-4e08-92be-08a02b6d58fb","Type":"ContainerDied","Data":"a2364e6bc5e1c8bf603a3562ff222dc54e4a9cf928a0a162031ea3eae15d674b"}
Jul 09 18:13:16.337076 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.337061    2583 scope.go:117] "RemoveContainer" containerID="f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32"
Jul 09 18:13:16.337392 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:13:16.337370    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32\": container with ID starting with f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32 not found: ID does not exist" containerID="f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32"
Jul 09 18:13:16.337464 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.337401    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32"} err="failed to get container status \"f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32\": rpc error: code = NotFound desc = could not find container \"f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32\": container with ID starting with f65670456c7ebfb4c0d01c12a5bbae57eec4454c3e762991297d3aaf3b87aa32 not found: ID does not exist"
Jul 09 18:13:16.352643 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.352620    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"]
Jul 09 18:13:16.358789 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.358767    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/sub-test-model-09d279-kserve-c9d7d69fc-v7824"]
Jul 09 18:13:16.406969 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.406915    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:13:16.549484 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549455    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-home\") pod \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") "
Jul 09 18:13:16.549630 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549494    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdccs\" (UniqueName: \"kubernetes.io/projected/9bf967f2-6c35-4e08-92be-08a02b6d58fb-kube-api-access-pdccs\") pod \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") "
Jul 09 18:13:16.549630 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549517    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tls-certs\") pod \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") "
Jul 09 18:13:16.549630 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549615    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-model-cache\") pod \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") "
Jul 09 18:13:16.549753 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549648    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-dshm\") pod \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") "
Jul 09 18:13:16.549753 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tmp-dir\") pod \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\" (UID: \"9bf967f2-6c35-4e08-92be-08a02b6d58fb\") "
Jul 09 18:13:16.549838 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549752    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-home" (OuterVolumeSpecName: "home") pod "9bf967f2-6c35-4e08-92be-08a02b6d58fb" (UID: "9bf967f2-6c35-4e08-92be-08a02b6d58fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:13:16.549953 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549919    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "9bf967f2-6c35-4e08-92be-08a02b6d58fb" (UID: "9bf967f2-6c35-4e08-92be-08a02b6d58fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:13:16.549953 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549942    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9bf967f2-6c35-4e08-92be-08a02b6d58fb" (UID: "9bf967f2-6c35-4e08-92be-08a02b6d58fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:13:16.550150 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.549991    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:16.551714 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.551694    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf967f2-6c35-4e08-92be-08a02b6d58fb-kube-api-access-pdccs" (OuterVolumeSpecName: "kube-api-access-pdccs") pod "9bf967f2-6c35-4e08-92be-08a02b6d58fb" (UID: "9bf967f2-6c35-4e08-92be-08a02b6d58fb"). InnerVolumeSpecName "kube-api-access-pdccs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:13:16.551714 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.551694    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-dshm" (OuterVolumeSpecName: "dshm") pod "9bf967f2-6c35-4e08-92be-08a02b6d58fb" (UID: "9bf967f2-6c35-4e08-92be-08a02b6d58fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:13:16.551872 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.551771    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9bf967f2-6c35-4e08-92be-08a02b6d58fb" (UID: "9bf967f2-6c35-4e08-92be-08a02b6d58fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:13:16.650860 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.650837    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdccs\" (UniqueName: \"kubernetes.io/projected/9bf967f2-6c35-4e08-92be-08a02b6d58fb-kube-api-access-pdccs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:16.650860 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.650858    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:16.650995 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.650869    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:16.650995 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.650876    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:16.650995 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.650884    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf967f2-6c35-4e08-92be-08a02b6d58fb-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:13:16.672010 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:16.671957    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25f7a63-f8bd-43a4-9cff-68a42f632da6" path="/var/lib/kubelet/pods/d25f7a63-f8bd-43a4-9cff-68a42f632da6/volumes"
Jul 09 18:13:17.337519 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:17.337495    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"
Jul 09 18:13:17.337966 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:17.337529    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6" event={"ID":"9bf967f2-6c35-4e08-92be-08a02b6d58fb","Type":"ContainerDied","Data":"b2cbf904fe651293c20613abc27966c8e00ed35e2f66d2188e092b4b4d59a749"}
Jul 09 18:13:17.337966 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:17.337578    2583 scope.go:117] "RemoveContainer" containerID="a2364e6bc5e1c8bf603a3562ff222dc54e4a9cf928a0a162031ea3eae15d674b"
Jul 09 18:13:17.357706 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:17.357675    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"]
Jul 09 18:13:17.364262 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:17.364240    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/sub-test-model-e0b9f9-kserve-69ff8f74d5-ct2q6"]
Jul 09 18:13:18.670192 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:18.670159    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bf967f2-6c35-4e08-92be-08a02b6d58fb" path="/var/lib/kubelet/pods/9bf967f2-6c35-4e08-92be-08a02b6d58fb/volumes"
Jul 09 18:13:20.320309 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:20.320266    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:20.320743 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:20.320358    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:20.333500 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:20.333473    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:20.367944 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:20.367917    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:13:36.019102 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:36.019062    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:36.120838 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:36.120805    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:44.052177 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:44.052140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:13:44.193581 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:13:44.193553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:14:01.590168 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.590135    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"]
Jul 09 18:14:01.590546 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.590493    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf967f2-6c35-4e08-92be-08a02b6d58fb" containerName="main"
Jul 09 18:14:01.590546 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.590504    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf967f2-6c35-4e08-92be-08a02b6d58fb" containerName="main"
Jul 09 18:14:01.590546 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.590513    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25f7a63-f8bd-43a4-9cff-68a42f632da6" containerName="main"
Jul 09 18:14:01.590546 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.590519    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25f7a63-f8bd-43a4-9cff-68a42f632da6" containerName="main"
Jul 09 18:14:01.590688 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.590581    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf967f2-6c35-4e08-92be-08a02b6d58fb" containerName="main"
Jul 09 18:14:01.590688 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.590592    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25f7a63-f8bd-43a4-9cff-68a42f632da6" containerName="main"
Jul 09 18:14:01.595056 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.595040    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.598138 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.598112    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"openshift-service-ca.crt\""
Jul 09 18:14:01.599558 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.599537    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"default-dockercfg-5pms8\""
Jul 09 18:14:01.599683 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.599601    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"kube-root-ca.crt\""
Jul 09 18:14:01.599683 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.599601    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e0b9f9\"/\"rate-test-model-e0b9f9-kserve-self-signed-certs\""
Jul 09 18:14:01.604647 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.604627    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"]
Jul 09 18:14:01.679515 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.679477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-home\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.679515 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.679517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tmp-dir\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.679666 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.679588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-dshm\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.679666 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.679616    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-model-cache\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.679666 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.679631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tls-certs\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.679666 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.679652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg7nb\" (UniqueName: \"kubernetes.io/projected/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-kube-api-access-hg7nb\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.688392 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.688369    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:14:01.780716 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.780693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-home\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.780803 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.780720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tmp-dir\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.780803 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.780769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-dshm\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.780803 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.780789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-model-cache\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.780930 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.780813    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tls-certs\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.780930 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.780860    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg7nb\" (UniqueName: \"kubernetes.io/projected/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-kube-api-access-hg7nb\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.781134 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.781109    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-home\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.781324 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.781122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tmp-dir\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.781529 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.781510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-model-cache\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.783080 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.783061    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-dshm\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.783247 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.783229    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tls-certs\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.790190 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.790167    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg7nb\" (UniqueName: \"kubernetes.io/projected/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-kube-api-access-hg7nb\") pod \"rate-test-model-e0b9f9-kserve-f4667dd55-slnrr\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") " pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:01.905842 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:01.905784    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:02.038394 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:02.038368    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"]
Jul 09 18:14:02.039748 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:14:02.039719    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82b3cdee_459c_4bea_b3a0_1a09d2327ef0.slice/crio-25903cf67e3506b8d62b0973931c225a8e50f31eb7bffe3c6a6334f5cb7ba970 WatchSource:0}: Error finding container 25903cf67e3506b8d62b0973931c225a8e50f31eb7bffe3c6a6334f5cb7ba970: Status 404 returned error can't find the container with id 25903cf67e3506b8d62b0973931c225a8e50f31eb7bffe3c6a6334f5cb7ba970
Jul 09 18:14:02.571887 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:02.571851    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr" event={"ID":"82b3cdee-459c-4bea-b3a0-1a09d2327ef0","Type":"ContainerStarted","Data":"ddaa053a4bd11ed99a860e1adeff6e59dad663cdf907504524150c784efab912"}
Jul 09 18:14:02.572072 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:02.571897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr" event={"ID":"82b3cdee-459c-4bea-b3a0-1a09d2327ef0","Type":"ContainerStarted","Data":"25903cf67e3506b8d62b0973931c225a8e50f31eb7bffe3c6a6334f5cb7ba970"}
Jul 09 18:14:02.595024 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:02.594973    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr" podStartSLOduration=1.594958654 podStartE2EDuration="1.594958654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:14:02.592709609 +0000 UTC m=+2766.375428970" watchObservedRunningTime="2026-07-09 18:14:02.594958654 +0000 UTC m=+2766.377677984"
Jul 09 18:14:11.906654 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:11.906618    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:11.906654 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:11.906658    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:11.919113 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:11.919085    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:12.631485 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:12.631454    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:14:20.399765 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:20.399693    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:14:23.331661 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:23.331621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:14:49.855706 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:49.855668    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"]
Jul 09 18:14:49.923108 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:49.923074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:14:50.761752 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:50.761719    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"]
Jul 09 18:14:50.786797 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:14:50.786767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:00.133251 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.133212    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"]
Jul 09 18:15:00.138264 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.138235    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"
Jul 09 18:15:00.139606 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.139581    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"]
Jul 09 18:15:00.141871 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.141846    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 18:15:00.143327 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.143301    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 18:15:00.143583 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.143548    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5lf9x\""
Jul 09 18:15:00.145981 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.145956    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"]
Jul 09 18:15:00.146099 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.146068    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"
Jul 09 18:15:00.151241 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.151182    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"]
Jul 09 18:15:00.151362 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.151344    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"
Jul 09 18:15:00.152446 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.152430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"]
Jul 09 18:15:00.155761 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.155742    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"]
Jul 09 18:15:00.334442 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.334408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9mxv\" (UniqueName: \"kubernetes.io/projected/aff57827-8b34-4ea1-95a0-7e26a9758096-kube-api-access-f9mxv\") pod \"maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh\" (UID: \"aff57827-8b34-4ea1-95a0-7e26a9758096\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"
Jul 09 18:15:00.334613 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.334479    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvc6n\" (UniqueName: \"kubernetes.io/projected/49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0-kube-api-access-dvc6n\") pod \"maas-api-key-cleanup-29727015-9b2gk\" (UID: \"49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"
Jul 09 18:15:00.334613 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.334528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcl4x\" (UniqueName: \"kubernetes.io/projected/0c31a799-cbfb-4432-933f-0a4ce7eb96ca-kube-api-access-hcl4x\") pod \"maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459\" (UID: \"0c31a799-cbfb-4432-933f-0a4ce7eb96ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"
Jul 09 18:15:00.435072 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.434996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvc6n\" (UniqueName: \"kubernetes.io/projected/49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0-kube-api-access-dvc6n\") pod \"maas-api-key-cleanup-29727015-9b2gk\" (UID: \"49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"
Jul 09 18:15:00.435072 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.435046    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcl4x\" (UniqueName: \"kubernetes.io/projected/0c31a799-cbfb-4432-933f-0a4ce7eb96ca-kube-api-access-hcl4x\") pod \"maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459\" (UID: \"0c31a799-cbfb-4432-933f-0a4ce7eb96ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"
Jul 09 18:15:00.435266 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.435088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9mxv\" (UniqueName: \"kubernetes.io/projected/aff57827-8b34-4ea1-95a0-7e26a9758096-kube-api-access-f9mxv\") pod \"maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh\" (UID: \"aff57827-8b34-4ea1-95a0-7e26a9758096\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"
Jul 09 18:15:00.444816 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.444784    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcl4x\" (UniqueName: \"kubernetes.io/projected/0c31a799-cbfb-4432-933f-0a4ce7eb96ca-kube-api-access-hcl4x\") pod \"maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459\" (UID: \"0c31a799-cbfb-4432-933f-0a4ce7eb96ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"
Jul 09 18:15:00.444816 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.444807    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9mxv\" (UniqueName: \"kubernetes.io/projected/aff57827-8b34-4ea1-95a0-7e26a9758096-kube-api-access-f9mxv\") pod \"maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh\" (UID: \"aff57827-8b34-4ea1-95a0-7e26a9758096\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"
Jul 09 18:15:00.444956 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.444861    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvc6n\" (UniqueName: \"kubernetes.io/projected/49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0-kube-api-access-dvc6n\") pod \"maas-api-key-cleanup-29727015-9b2gk\" (UID: \"49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"
Jul 09 18:15:00.457622 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.457602    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"
Jul 09 18:15:00.463711 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.463695    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"
Jul 09 18:15:00.472324 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.469491    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"
Jul 09 18:15:00.616338 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.616260    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"]
Jul 09 18:15:00.620564 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:15:00.620528    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff57827_8b34_4ea1_95a0_7e26a9758096.slice/crio-5d69d7b31beb6802c2ac5c2b631698ffdf44ddfcc798f1145c7b7110a87181e7 WatchSource:0}: Error finding container 5d69d7b31beb6802c2ac5c2b631698ffdf44ddfcc798f1145c7b7110a87181e7: Status 404 returned error can't find the container with id 5d69d7b31beb6802c2ac5c2b631698ffdf44ddfcc798f1145c7b7110a87181e7
Jul 09 18:15:00.642636 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.642600    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"]
Jul 09 18:15:00.643979 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:15:00.643946    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c31a799_cbfb_4432_933f_0a4ce7eb96ca.slice/crio-65cb43eb3e53669fc50af3f5f5d0ecdeaacfb26807d7b39ebaf49be49891ffd7 WatchSource:0}: Error finding container 65cb43eb3e53669fc50af3f5f5d0ecdeaacfb26807d7b39ebaf49be49891ffd7: Status 404 returned error can't find the container with id 65cb43eb3e53669fc50af3f5f5d0ecdeaacfb26807d7b39ebaf49be49891ffd7
Jul 09 18:15:00.663065 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.663041    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"]
Jul 09 18:15:00.664748 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:15:00.664727    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a7ac9b_19fa_40e1_9e12_0e7a504ad4f0.slice/crio-950c05a95ecf96c7b06e789cd4e98c30606c9a103553ab5bd4bf6bfce9a422f5 WatchSource:0}: Error finding container 950c05a95ecf96c7b06e789cd4e98c30606c9a103553ab5bd4bf6bfce9a422f5: Status 404 returned error can't find the container with id 950c05a95ecf96c7b06e789cd4e98c30606c9a103553ab5bd4bf6bfce9a422f5
Jul 09 18:15:00.866132 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.866105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk" event={"ID":"49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0","Type":"ContainerStarted","Data":"950c05a95ecf96c7b06e789cd4e98c30606c9a103553ab5bd4bf6bfce9a422f5"}
Jul 09 18:15:00.867591 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.867561    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh" event={"ID":"aff57827-8b34-4ea1-95a0-7e26a9758096","Type":"ContainerStarted","Data":"ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1"}
Jul 09 18:15:00.867700 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.867619    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh" event={"ID":"aff57827-8b34-4ea1-95a0-7e26a9758096","Type":"ContainerStarted","Data":"5d69d7b31beb6802c2ac5c2b631698ffdf44ddfcc798f1145c7b7110a87181e7"}
Jul 09 18:15:00.868676 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.868654    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459" event={"ID":"0c31a799-cbfb-4432-933f-0a4ce7eb96ca","Type":"ContainerStarted","Data":"65cb43eb3e53669fc50af3f5f5d0ecdeaacfb26807d7b39ebaf49be49891ffd7"}
Jul 09 18:15:00.882832 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:00.882784    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh" podStartSLOduration=0.882771959 podStartE2EDuration="882.771959ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:15:00.881781648 +0000 UTC m=+2824.664500982" watchObservedRunningTime="2026-07-09 18:15:00.882771959 +0000 UTC m=+2824.665491289"
Jul 09 18:15:01.875623 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:01.875587    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459" event={"ID":"0c31a799-cbfb-4432-933f-0a4ce7eb96ca","Type":"ContainerStarted","Data":"2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f"}
Jul 09 18:15:01.877179 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:01.877148    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk" event={"ID":"49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0","Type":"ContainerStarted","Data":"d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68"}
Jul 09 18:15:01.894424 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:01.894376    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459" podStartSLOduration=1.894362178 podStartE2EDuration="1.894362178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:15:01.89185651 +0000 UTC m=+2825.674575842" watchObservedRunningTime="2026-07-09 18:15:01.894362178 +0000 UTC m=+2825.677081562"
Jul 09 18:15:01.908601 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:01.908557    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk" podStartSLOduration=1.908545271 podStartE2EDuration="1.908545271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:15:01.906794909 +0000 UTC m=+2825.689514253" watchObservedRunningTime="2026-07-09 18:15:01.908545271 +0000 UTC m=+2825.691264601"
Jul 09 18:15:04.875619 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:04.875575    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb" podUID="076a62ac-128d-46b8-9b35-b7d12590720f" containerName="main" containerID="cri-o://1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a" gracePeriod=45
Jul 09 18:15:05.124931 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.124908    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:15:05.169782 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.169704    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-tmp-dir\") pod \"076a62ac-128d-46b8-9b35-b7d12590720f\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") "
Jul 09 18:15:05.169782 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.169741    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-model-cache\") pod \"076a62ac-128d-46b8-9b35-b7d12590720f\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") "
Jul 09 18:15:05.169782 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.169770    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/076a62ac-128d-46b8-9b35-b7d12590720f-tls-certs\") pod \"076a62ac-128d-46b8-9b35-b7d12590720f\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") "
Jul 09 18:15:05.170032 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.169827    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-home\") pod \"076a62ac-128d-46b8-9b35-b7d12590720f\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") "
Jul 09 18:15:05.170032 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.169870    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dpmn\" (UniqueName: \"kubernetes.io/projected/076a62ac-128d-46b8-9b35-b7d12590720f-kube-api-access-8dpmn\") pod \"076a62ac-128d-46b8-9b35-b7d12590720f\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") "
Jul 09 18:15:05.170032 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.169899    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-dshm\") pod \"076a62ac-128d-46b8-9b35-b7d12590720f\" (UID: \"076a62ac-128d-46b8-9b35-b7d12590720f\") "
Jul 09 18:15:05.170032 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.169942    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "076a62ac-128d-46b8-9b35-b7d12590720f" (UID: "076a62ac-128d-46b8-9b35-b7d12590720f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:15:05.170234 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.170040    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-model-cache" (OuterVolumeSpecName: "model-cache") pod "076a62ac-128d-46b8-9b35-b7d12590720f" (UID: "076a62ac-128d-46b8-9b35-b7d12590720f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:15:05.170234 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.170121    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-home" (OuterVolumeSpecName: "home") pod "076a62ac-128d-46b8-9b35-b7d12590720f" (UID: "076a62ac-128d-46b8-9b35-b7d12590720f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:15:05.170355 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.170306    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:05.170355 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.170322    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:05.170355 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.170331    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:05.172022 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.171997    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/076a62ac-128d-46b8-9b35-b7d12590720f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "076a62ac-128d-46b8-9b35-b7d12590720f" (UID: "076a62ac-128d-46b8-9b35-b7d12590720f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:15:05.172123 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.172052    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-dshm" (OuterVolumeSpecName: "dshm") pod "076a62ac-128d-46b8-9b35-b7d12590720f" (UID: "076a62ac-128d-46b8-9b35-b7d12590720f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:15:05.172123 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.172070    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076a62ac-128d-46b8-9b35-b7d12590720f-kube-api-access-8dpmn" (OuterVolumeSpecName: "kube-api-access-8dpmn") pod "076a62ac-128d-46b8-9b35-b7d12590720f" (UID: "076a62ac-128d-46b8-9b35-b7d12590720f"). InnerVolumeSpecName "kube-api-access-8dpmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:15:05.271348 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.271318    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dpmn\" (UniqueName: \"kubernetes.io/projected/076a62ac-128d-46b8-9b35-b7d12590720f-kube-api-access-8dpmn\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:05.271348 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.271345    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/076a62ac-128d-46b8-9b35-b7d12590720f-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:05.271526 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.271355    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/076a62ac-128d-46b8-9b35-b7d12590720f-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:05.781500 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.781452    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr" podUID="82b3cdee-459c-4bea-b3a0-1a09d2327ef0" containerName="main" containerID="cri-o://ddaa053a4bd11ed99a860e1adeff6e59dad663cdf907504524150c784efab912" gracePeriod=45
Jul 09 18:15:05.900303 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.900265    2583 generic.go:356] "Generic (PLEG): container finished" podID="076a62ac-128d-46b8-9b35-b7d12590720f" containerID="1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a" exitCode=0
Jul 09 18:15:05.900633 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.900324    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"
Jul 09 18:15:05.900633 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.900381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb" event={"ID":"076a62ac-128d-46b8-9b35-b7d12590720f","Type":"ContainerDied","Data":"1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a"}
Jul 09 18:15:05.900633 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.900418    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb" event={"ID":"076a62ac-128d-46b8-9b35-b7d12590720f","Type":"ContainerDied","Data":"a01cc42226cec111cf519b5da5663c08427f55457446d565b17706a460ceeb0f"}
Jul 09 18:15:05.900633 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.900440    2583 scope.go:117] "RemoveContainer" containerID="1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a"
Jul 09 18:15:05.902248 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.902190    2583 generic.go:356] "Generic (PLEG): container finished" podID="82b3cdee-459c-4bea-b3a0-1a09d2327ef0" containerID="ddaa053a4bd11ed99a860e1adeff6e59dad663cdf907504524150c784efab912" exitCode=0
Jul 09 18:15:05.902248 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.902233    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr" event={"ID":"82b3cdee-459c-4bea-b3a0-1a09d2327ef0","Type":"ContainerDied","Data":"ddaa053a4bd11ed99a860e1adeff6e59dad663cdf907504524150c784efab912"}
Jul 09 18:15:05.910771 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.910746    2583 scope.go:117] "RemoveContainer" containerID="1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a"
Jul 09 18:15:05.911163 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:15:05.911137    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a\": container with ID starting with 1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a not found: ID does not exist" containerID="1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a"
Jul 09 18:15:05.911279 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.911175    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a"} err="failed to get container status \"1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a\": rpc error: code = NotFound desc = could not find container \"1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a\": container with ID starting with 1e5d6082fc136a29ff86c4fddeee44cdd49cc6b262ed4e8ee528072b9693402a not found: ID does not exist"
Jul 09 18:15:05.922728 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.922695    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"]
Jul 09 18:15:05.925944 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:05.925924    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-09d279/rate-test-model-09d279-kserve-5b64f5464c-9zmjb"]
Jul 09 18:15:06.031992 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.031936    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:15:06.078452 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-home\") pod \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") "
Jul 09 18:15:06.078586 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078456    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-model-cache\") pod \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") "
Jul 09 18:15:06.078586 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078493    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tls-certs\") pod \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") "
Jul 09 18:15:06.078586 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078551    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg7nb\" (UniqueName: \"kubernetes.io/projected/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-kube-api-access-hg7nb\") pod \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") "
Jul 09 18:15:06.078755 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078587    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-dshm\") pod \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") "
Jul 09 18:15:06.078755 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078642    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tmp-dir\") pod \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\" (UID: \"82b3cdee-459c-4bea-b3a0-1a09d2327ef0\") "
Jul 09 18:15:06.078755 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078716    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-home" (OuterVolumeSpecName: "home") pod "82b3cdee-459c-4bea-b3a0-1a09d2327ef0" (UID: "82b3cdee-459c-4bea-b3a0-1a09d2327ef0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:15:06.078916 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078722    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-model-cache" (OuterVolumeSpecName: "model-cache") pod "82b3cdee-459c-4bea-b3a0-1a09d2327ef0" (UID: "82b3cdee-459c-4bea-b3a0-1a09d2327ef0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:15:06.078969 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078951    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-home\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:06.078969 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078955    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82b3cdee-459c-4bea-b3a0-1a09d2327ef0" (UID: "82b3cdee-459c-4bea-b3a0-1a09d2327ef0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:15:06.079071 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.078970    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-model-cache\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:06.080798 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.080775    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-dshm" (OuterVolumeSpecName: "dshm") pod "82b3cdee-459c-4bea-b3a0-1a09d2327ef0" (UID: "82b3cdee-459c-4bea-b3a0-1a09d2327ef0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:15:06.080798 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.080785    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82b3cdee-459c-4bea-b3a0-1a09d2327ef0" (UID: "82b3cdee-459c-4bea-b3a0-1a09d2327ef0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:15:06.080903 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.080788    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-kube-api-access-hg7nb" (OuterVolumeSpecName: "kube-api-access-hg7nb") pod "82b3cdee-459c-4bea-b3a0-1a09d2327ef0" (UID: "82b3cdee-459c-4bea-b3a0-1a09d2327ef0"). InnerVolumeSpecName "kube-api-access-hg7nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:15:06.179782 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.179751    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tls-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:06.179782 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.179778    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg7nb\" (UniqueName: \"kubernetes.io/projected/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-kube-api-access-hg7nb\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:06.179782 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.179787    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-dshm\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:06.179991 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.179796    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82b3cdee-459c-4bea-b3a0-1a09d2327ef0-tmp-dir\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:06.670567 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.670537    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076a62ac-128d-46b8-9b35-b7d12590720f" path="/var/lib/kubelet/pods/076a62ac-128d-46b8-9b35-b7d12590720f/volumes"
Jul 09 18:15:06.910464 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.910430    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr" event={"ID":"82b3cdee-459c-4bea-b3a0-1a09d2327ef0","Type":"ContainerDied","Data":"25903cf67e3506b8d62b0973931c225a8e50f31eb7bffe3c6a6334f5cb7ba970"}
Jul 09 18:15:06.910464 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.910442    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"
Jul 09 18:15:06.910983 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.910477    2583 scope.go:117] "RemoveContainer" containerID="ddaa053a4bd11ed99a860e1adeff6e59dad663cdf907504524150c784efab912"
Jul 09 18:15:06.929852 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.929799    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"]
Jul 09 18:15:06.935429 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:06.935408    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e0b9f9/rate-test-model-e0b9f9-kserve-f4667dd55-slnrr"]
Jul 09 18:15:08.670030 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:08.669998    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b3cdee-459c-4bea-b3a0-1a09d2327ef0" path="/var/lib/kubelet/pods/82b3cdee-459c-4bea-b3a0-1a09d2327ef0/volumes"
Jul 09 18:15:13.450508 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.450473    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7170-140264194319024"]
Jul 09 18:15:13.450933 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.450828    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b3cdee-459c-4bea-b3a0-1a09d2327ef0" containerName="main"
Jul 09 18:15:13.450933 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.450842    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b3cdee-459c-4bea-b3a0-1a09d2327ef0" containerName="main"
Jul 09 18:15:13.450933 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.450854    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076a62ac-128d-46b8-9b35-b7d12590720f" containerName="main"
Jul 09 18:15:13.450933 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.450860    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="076a62ac-128d-46b8-9b35-b7d12590720f" containerName="main"
Jul 09 18:15:13.450933 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.450921    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b3cdee-459c-4bea-b3a0-1a09d2327ef0" containerName="main"
Jul 09 18:15:13.450933 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.450933    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="076a62ac-128d-46b8-9b35-b7d12590720f" containerName="main"
Jul 09 18:15:13.455242 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.455222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194319024"
Jul 09 18:15:13.459483 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.459460    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-sj5sr\""
Jul 09 18:15:13.460356 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.460335    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194319024"]
Jul 09 18:15:13.537466 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.537439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq48q\" (UniqueName: \"kubernetes.io/projected/5a204e83-2ad1-49af-bdd0-c71ae6b9b01d-kube-api-access-dq48q\") pod \"test-curl-7170-140264194319024\" (UID: \"5a204e83-2ad1-49af-bdd0-c71ae6b9b01d\") " pod="openshift-ingress/test-curl-7170-140264194319024"
Jul 09 18:15:13.638492 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.638470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq48q\" (UniqueName: \"kubernetes.io/projected/5a204e83-2ad1-49af-bdd0-c71ae6b9b01d-kube-api-access-dq48q\") pod \"test-curl-7170-140264194319024\" (UID: \"5a204e83-2ad1-49af-bdd0-c71ae6b9b01d\") " pod="openshift-ingress/test-curl-7170-140264194319024"
Jul 09 18:15:13.647594 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.647570    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq48q\" (UniqueName: \"kubernetes.io/projected/5a204e83-2ad1-49af-bdd0-c71ae6b9b01d-kube-api-access-dq48q\") pod \"test-curl-7170-140264194319024\" (UID: \"5a204e83-2ad1-49af-bdd0-c71ae6b9b01d\") " pod="openshift-ingress/test-curl-7170-140264194319024"
Jul 09 18:15:13.765570 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.765514    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194319024"
Jul 09 18:15:13.892753 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.892728    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194319024"]
Jul 09 18:15:13.894028 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:15:13.894003    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a204e83_2ad1_49af_bdd0_c71ae6b9b01d.slice/crio-58b8855e81aa8fc95bfb955aa2db357fbcd58bf6c3f8f66207664cbe9b0d7a79 WatchSource:0}: Error finding container 58b8855e81aa8fc95bfb955aa2db357fbcd58bf6c3f8f66207664cbe9b0d7a79: Status 404 returned error can't find the container with id 58b8855e81aa8fc95bfb955aa2db357fbcd58bf6c3f8f66207664cbe9b0d7a79
Jul 09 18:15:13.895305 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.895291    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:15:13.950450 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:13.950427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194319024" event={"ID":"5a204e83-2ad1-49af-bdd0-c71ae6b9b01d","Type":"ContainerStarted","Data":"58b8855e81aa8fc95bfb955aa2db357fbcd58bf6c3f8f66207664cbe9b0d7a79"}
Jul 09 18:15:14.957660 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:14.957585    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a204e83-2ad1-49af-bdd0-c71ae6b9b01d" containerID="076c8783fae0af1345e38d788b1606803a9bb01560f7cf4e68d95b4984f86ae1" exitCode=0
Jul 09 18:15:14.957979 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:14.957675    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194319024" event={"ID":"5a204e83-2ad1-49af-bdd0-c71ae6b9b01d","Type":"ContainerDied","Data":"076c8783fae0af1345e38d788b1606803a9bb01560f7cf4e68d95b4984f86ae1"}
Jul 09 18:15:16.092959 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.092929    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194319024"
Jul 09 18:15:16.113786 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.113763    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7170-140264194319024_5a204e83-2ad1-49af-bdd0-c71ae6b9b01d/test-curl-7170-140264194319024/0.log"
Jul 09 18:15:16.137934 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.137907    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7170-140264194319024"]
Jul 09 18:15:16.139995 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.139975    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7170-140264194319024"]
Jul 09 18:15:16.157094 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.157069    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq48q\" (UniqueName: \"kubernetes.io/projected/5a204e83-2ad1-49af-bdd0-c71ae6b9b01d-kube-api-access-dq48q\") pod \"5a204e83-2ad1-49af-bdd0-c71ae6b9b01d\" (UID: \"5a204e83-2ad1-49af-bdd0-c71ae6b9b01d\") "
Jul 09 18:15:16.159070 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.159048    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a204e83-2ad1-49af-bdd0-c71ae6b9b01d-kube-api-access-dq48q" (OuterVolumeSpecName: "kube-api-access-dq48q") pod "5a204e83-2ad1-49af-bdd0-c71ae6b9b01d" (UID: "5a204e83-2ad1-49af-bdd0-c71ae6b9b01d"). InnerVolumeSpecName "kube-api-access-dq48q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:15:16.258623 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.258553    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq48q\" (UniqueName: \"kubernetes.io/projected/5a204e83-2ad1-49af-bdd0-c71ae6b9b01d-kube-api-access-dq48q\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:16.266874 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.266845    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7170-140264194320048"]
Jul 09 18:15:16.267193 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.267181    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a204e83-2ad1-49af-bdd0-c71ae6b9b01d" containerName="test-curl-7170-140264194319024"
Jul 09 18:15:16.267268 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.267195    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a204e83-2ad1-49af-bdd0-c71ae6b9b01d" containerName="test-curl-7170-140264194319024"
Jul 09 18:15:16.267307 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.267299    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a204e83-2ad1-49af-bdd0-c71ae6b9b01d" containerName="test-curl-7170-140264194319024"
Jul 09 18:15:16.270349 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.270333    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194320048"
Jul 09 18:15:16.276670 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.276649    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194320048"]
Jul 09 18:15:16.359345 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.359315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwb8\" (UniqueName: \"kubernetes.io/projected/d4fe0318-7a6b-4191-943d-0345a6d7d5c1-kube-api-access-dlwb8\") pod \"test-curl-7170-140264194320048\" (UID: \"d4fe0318-7a6b-4191-943d-0345a6d7d5c1\") " pod="openshift-ingress/test-curl-7170-140264194320048"
Jul 09 18:15:16.459821 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.459780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwb8\" (UniqueName: \"kubernetes.io/projected/d4fe0318-7a6b-4191-943d-0345a6d7d5c1-kube-api-access-dlwb8\") pod \"test-curl-7170-140264194320048\" (UID: \"d4fe0318-7a6b-4191-943d-0345a6d7d5c1\") " pod="openshift-ingress/test-curl-7170-140264194320048"
Jul 09 18:15:16.468918 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.468891    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwb8\" (UniqueName: \"kubernetes.io/projected/d4fe0318-7a6b-4191-943d-0345a6d7d5c1-kube-api-access-dlwb8\") pod \"test-curl-7170-140264194320048\" (UID: \"d4fe0318-7a6b-4191-943d-0345a6d7d5c1\") " pod="openshift-ingress/test-curl-7170-140264194320048"
Jul 09 18:15:16.579730 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.579705    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194320048"
Jul 09 18:15:16.673261 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.673230    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a204e83-2ad1-49af-bdd0-c71ae6b9b01d" path="/var/lib/kubelet/pods/5a204e83-2ad1-49af-bdd0-c71ae6b9b01d/volumes"
Jul 09 18:15:16.708881 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.708852    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194320048"]
Jul 09 18:15:16.710106 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:15:16.710087    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4fe0318_7a6b_4191_943d_0345a6d7d5c1.slice/crio-865f2d7d731a635e138ad022be6f8a13146adddc9857a7ca17bd56e194ca4f41 WatchSource:0}: Error finding container 865f2d7d731a635e138ad022be6f8a13146adddc9857a7ca17bd56e194ca4f41: Status 404 returned error can't find the container with id 865f2d7d731a635e138ad022be6f8a13146adddc9857a7ca17bd56e194ca4f41
Jul 09 18:15:16.969278 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.969187    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194319024"
Jul 09 18:15:16.969278 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.969218    2583 scope.go:117] "RemoveContainer" containerID="076c8783fae0af1345e38d788b1606803a9bb01560f7cf4e68d95b4984f86ae1"
Jul 09 18:15:16.970583 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:16.970467    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194320048" event={"ID":"d4fe0318-7a6b-4191-943d-0345a6d7d5c1","Type":"ContainerStarted","Data":"865f2d7d731a635e138ad022be6f8a13146adddc9857a7ca17bd56e194ca4f41"}
Jul 09 18:15:17.977885 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:17.977841    2583 generic.go:356] "Generic (PLEG): container finished" podID="d4fe0318-7a6b-4191-943d-0345a6d7d5c1" containerID="25ab3234806b946802637a175bc24c11e618da28155770f513b6d774e012020a" exitCode=0
Jul 09 18:15:17.978255 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:17.977893    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194320048" event={"ID":"d4fe0318-7a6b-4191-943d-0345a6d7d5c1","Type":"ContainerDied","Data":"25ab3234806b946802637a175bc24c11e618da28155770f513b6d774e012020a"}
Jul 09 18:15:19.116773 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.116746    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194320048"
Jul 09 18:15:19.137869 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.137847    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7170-140264194320048_d4fe0318-7a6b-4191-943d-0345a6d7d5c1/test-curl-7170-140264194320048/0.log"
Jul 09 18:15:19.162118 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.162091    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7170-140264194320048"]
Jul 09 18:15:19.167066 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.167045    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7170-140264194320048"]
Jul 09 18:15:19.180393 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.180367    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlwb8\" (UniqueName: \"kubernetes.io/projected/d4fe0318-7a6b-4191-943d-0345a6d7d5c1-kube-api-access-dlwb8\") pod \"d4fe0318-7a6b-4191-943d-0345a6d7d5c1\" (UID: \"d4fe0318-7a6b-4191-943d-0345a6d7d5c1\") "
Jul 09 18:15:19.182387 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.182360    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4fe0318-7a6b-4191-943d-0345a6d7d5c1-kube-api-access-dlwb8" (OuterVolumeSpecName: "kube-api-access-dlwb8") pod "d4fe0318-7a6b-4191-943d-0345a6d7d5c1" (UID: "d4fe0318-7a6b-4191-943d-0345a6d7d5c1"). InnerVolumeSpecName "kube-api-access-dlwb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:15:19.281899 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.281849    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlwb8\" (UniqueName: \"kubernetes.io/projected/d4fe0318-7a6b-4191-943d-0345a6d7d5c1-kube-api-access-dlwb8\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:19.346382 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.346355    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:19.346717 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.346705    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4fe0318-7a6b-4191-943d-0345a6d7d5c1" containerName="test-curl-7170-140264194320048"
Jul 09 18:15:19.346756 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.346719    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4fe0318-7a6b-4191-943d-0345a6d7d5c1" containerName="test-curl-7170-140264194320048"
Jul 09 18:15:19.346795 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.346775    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4fe0318-7a6b-4191-943d-0345a6d7d5c1" containerName="test-curl-7170-140264194320048"
Jul 09 18:15:19.349893 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.349876    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:19.355926 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.355903    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:19.383031 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.383007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wb8n\" (UniqueName: \"kubernetes.io/projected/b2ab213d-38ae-4452-b9fa-efae3689361b-kube-api-access-6wb8n\") pod \"test-curl-7170-140264194474032\" (UID: \"b2ab213d-38ae-4452-b9fa-efae3689361b\") " pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:19.483853 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.483829    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb8n\" (UniqueName: \"kubernetes.io/projected/b2ab213d-38ae-4452-b9fa-efae3689361b-kube-api-access-6wb8n\") pod \"test-curl-7170-140264194474032\" (UID: \"b2ab213d-38ae-4452-b9fa-efae3689361b\") " pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:19.492238 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.492212    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wb8n\" (UniqueName: \"kubernetes.io/projected/b2ab213d-38ae-4452-b9fa-efae3689361b-kube-api-access-6wb8n\") pod \"test-curl-7170-140264194474032\" (UID: \"b2ab213d-38ae-4452-b9fa-efae3689361b\") " pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:19.658625 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.658589    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:19.783794 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.783764    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:19.785125 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:15:19.785102    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2ab213d_38ae_4452_b9fa_efae3689361b.slice/crio-20381b52bd373a47cfb68e4903c5de2ab467981762884bcfab1d8e2f14b04bba WatchSource:0}: Error finding container 20381b52bd373a47cfb68e4903c5de2ab467981762884bcfab1d8e2f14b04bba: Status 404 returned error can't find the container with id 20381b52bd373a47cfb68e4903c5de2ab467981762884bcfab1d8e2f14b04bba
Jul 09 18:15:19.990313 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.990221    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194474032" event={"ID":"b2ab213d-38ae-4452-b9fa-efae3689361b","Type":"ContainerStarted","Data":"20381b52bd373a47cfb68e4903c5de2ab467981762884bcfab1d8e2f14b04bba"}
Jul 09 18:15:19.991501 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.991469    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="865f2d7d731a635e138ad022be6f8a13146adddc9857a7ca17bd56e194ca4f41"
Jul 09 18:15:19.991501 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:19.991483    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194320048"
Jul 09 18:15:20.002866 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:15:20.002829    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7170-140264194320048\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="d4fe0318-7a6b-4191-943d-0345a6d7d5c1" pod="openshift-ingress/test-curl-7170-140264194320048"
Jul 09 18:15:20.671077 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:20.671041    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4fe0318-7a6b-4191-943d-0345a6d7d5c1" path="/var/lib/kubelet/pods/d4fe0318-7a6b-4191-943d-0345a6d7d5c1/volumes"
Jul 09 18:15:20.998712 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:20.998631    2583 generic.go:356] "Generic (PLEG): container finished" podID="b2ab213d-38ae-4452-b9fa-efae3689361b" containerID="1f0e01d4a95479ac2e666e080a3ee3a11547db58df725110e8002ccc50d7e9f0" exitCode=0
Jul 09 18:15:20.998855 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:20.998717    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194474032" event={"ID":"b2ab213d-38ae-4452-b9fa-efae3689361b","Type":"ContainerDied","Data":"1f0e01d4a95479ac2e666e080a3ee3a11547db58df725110e8002ccc50d7e9f0"}
Jul 09 18:15:22.135275 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.135251    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:22.154687 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.154661    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7170-140264194474032_b2ab213d-38ae-4452-b9fa-efae3689361b/test-curl-7170-140264194474032/0.log"
Jul 09 18:15:22.177041 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.177009    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:22.180930 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.180909    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:22.202964 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.202944    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wb8n\" (UniqueName: \"kubernetes.io/projected/b2ab213d-38ae-4452-b9fa-efae3689361b-kube-api-access-6wb8n\") pod \"b2ab213d-38ae-4452-b9fa-efae3689361b\" (UID: \"b2ab213d-38ae-4452-b9fa-efae3689361b\") "
Jul 09 18:15:22.204890 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.204869    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ab213d-38ae-4452-b9fa-efae3689361b-kube-api-access-6wb8n" (OuterVolumeSpecName: "kube-api-access-6wb8n") pod "b2ab213d-38ae-4452-b9fa-efae3689361b" (UID: "b2ab213d-38ae-4452-b9fa-efae3689361b"). InnerVolumeSpecName "kube-api-access-6wb8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:15:22.304414 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.304358    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wb8n\" (UniqueName: \"kubernetes.io/projected/b2ab213d-38ae-4452-b9fa-efae3689361b-kube-api-access-6wb8n\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:22.310219 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.310181    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:22.310594 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.310577    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ab213d-38ae-4452-b9fa-efae3689361b" containerName="test-curl-7170-140264194474032"
Jul 09 18:15:22.310681 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.310596    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ab213d-38ae-4452-b9fa-efae3689361b" containerName="test-curl-7170-140264194474032"
Jul 09 18:15:22.310756 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.310743    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ab213d-38ae-4452-b9fa-efae3689361b" containerName="test-curl-7170-140264194474032"
Jul 09 18:15:22.313862 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.313843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:22.322548 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.322526    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:22.405014 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.404989    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwqks\" (UniqueName: \"kubernetes.io/projected/5c228385-5dae-4ce4-9214-7ed7075be8d8-kube-api-access-hwqks\") pod \"test-curl-7170-140264194474032\" (UID: \"5c228385-5dae-4ce4-9214-7ed7075be8d8\") " pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:22.506044 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.506018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqks\" (UniqueName: \"kubernetes.io/projected/5c228385-5dae-4ce4-9214-7ed7075be8d8-kube-api-access-hwqks\") pod \"test-curl-7170-140264194474032\" (UID: \"5c228385-5dae-4ce4-9214-7ed7075be8d8\") " pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:22.515395 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.515365    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwqks\" (UniqueName: \"kubernetes.io/projected/5c228385-5dae-4ce4-9214-7ed7075be8d8-kube-api-access-hwqks\") pod \"test-curl-7170-140264194474032\" (UID: \"5c228385-5dae-4ce4-9214-7ed7075be8d8\") " pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:22.623989 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.623963    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:22.675025 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.674999    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ab213d-38ae-4452-b9fa-efae3689361b" path="/var/lib/kubelet/pods/b2ab213d-38ae-4452-b9fa-efae3689361b/volumes"
Jul 09 18:15:22.764689 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:22.764663    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:22.765762 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:15:22.765729    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c228385_5dae_4ce4_9214_7ed7075be8d8.slice/crio-63aaf52299619b7c3bf2861deba6ce0c21c2f23a360ae68dfdf6233bfaca1b3a WatchSource:0}: Error finding container 63aaf52299619b7c3bf2861deba6ce0c21c2f23a360ae68dfdf6233bfaca1b3a: Status 404 returned error can't find the container with id 63aaf52299619b7c3bf2861deba6ce0c21c2f23a360ae68dfdf6233bfaca1b3a
Jul 09 18:15:23.009882 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:23.009821    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194474032" event={"ID":"5c228385-5dae-4ce4-9214-7ed7075be8d8","Type":"ContainerStarted","Data":"63aaf52299619b7c3bf2861deba6ce0c21c2f23a360ae68dfdf6233bfaca1b3a"}
Jul 09 18:15:23.011124 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:23.011106    2583 scope.go:117] "RemoveContainer" containerID="1f0e01d4a95479ac2e666e080a3ee3a11547db58df725110e8002ccc50d7e9f0"
Jul 09 18:15:23.011219 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:23.011131    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:24.019173 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:24.019139    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c228385-5dae-4ce4-9214-7ed7075be8d8" containerID="599a46a50fa2fe728eef9ff41dd582a1ad064a96ef1063b22899e593fd11b6d0" exitCode=0
Jul 09 18:15:24.019563 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:24.019222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194474032" event={"ID":"5c228385-5dae-4ce4-9214-7ed7075be8d8","Type":"ContainerDied","Data":"599a46a50fa2fe728eef9ff41dd582a1ad064a96ef1063b22899e593fd11b6d0"}
Jul 09 18:15:25.156358 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.156332    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:25.176998 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.176973    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7170-140264194474032_5c228385-5dae-4ce4-9214-7ed7075be8d8/test-curl-7170-140264194474032/0.log"
Jul 09 18:15:25.200702 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.200674    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:25.204280 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.204258    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474032"]
Jul 09 18:15:25.227396 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.227370    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwqks\" (UniqueName: \"kubernetes.io/projected/5c228385-5dae-4ce4-9214-7ed7075be8d8-kube-api-access-hwqks\") pod \"5c228385-5dae-4ce4-9214-7ed7075be8d8\" (UID: \"5c228385-5dae-4ce4-9214-7ed7075be8d8\") "
Jul 09 18:15:25.229422 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.229394    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c228385-5dae-4ce4-9214-7ed7075be8d8-kube-api-access-hwqks" (OuterVolumeSpecName: "kube-api-access-hwqks") pod "5c228385-5dae-4ce4-9214-7ed7075be8d8" (UID: "5c228385-5dae-4ce4-9214-7ed7075be8d8"). InnerVolumeSpecName "kube-api-access-hwqks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:15:25.328788 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.328762    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwqks\" (UniqueName: \"kubernetes.io/projected/5c228385-5dae-4ce4-9214-7ed7075be8d8-kube-api-access-hwqks\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:25.329733 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.329715    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:25.330082 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.330071    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c228385-5dae-4ce4-9214-7ed7075be8d8" containerName="test-curl-7170-140264194474032"
Jul 09 18:15:25.330117 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.330084    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c228385-5dae-4ce4-9214-7ed7075be8d8" containerName="test-curl-7170-140264194474032"
Jul 09 18:15:25.330166 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.330142    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c228385-5dae-4ce4-9214-7ed7075be8d8" containerName="test-curl-7170-140264194474032"
Jul 09 18:15:25.333265 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.333250    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:25.338705 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.338680    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:25.429917 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.429887    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7tmz\" (UniqueName: \"kubernetes.io/projected/2124cf41-0aea-4909-8c16-9def6fb8bff2-kube-api-access-h7tmz\") pod \"test-curl-7170-140264194474896\" (UID: \"2124cf41-0aea-4909-8c16-9def6fb8bff2\") " pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:25.530782 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.530754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7tmz\" (UniqueName: \"kubernetes.io/projected/2124cf41-0aea-4909-8c16-9def6fb8bff2-kube-api-access-h7tmz\") pod \"test-curl-7170-140264194474896\" (UID: \"2124cf41-0aea-4909-8c16-9def6fb8bff2\") " pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:25.539834 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.539812    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7tmz\" (UniqueName: \"kubernetes.io/projected/2124cf41-0aea-4909-8c16-9def6fb8bff2-kube-api-access-h7tmz\") pod \"test-curl-7170-140264194474896\" (UID: \"2124cf41-0aea-4909-8c16-9def6fb8bff2\") " pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:25.643636 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.643579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:25.771673 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:25.771653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:25.773031 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:15:25.773004    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2124cf41_0aea_4909_8c16_9def6fb8bff2.slice/crio-6843717896f4e87209ed46dc3d5acf10bf1c8ccde5d24e8e98e812e8773858cb WatchSource:0}: Error finding container 6843717896f4e87209ed46dc3d5acf10bf1c8ccde5d24e8e98e812e8773858cb: Status 404 returned error can't find the container with id 6843717896f4e87209ed46dc3d5acf10bf1c8ccde5d24e8e98e812e8773858cb
Jul 09 18:15:26.031228 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:26.031142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194474896" event={"ID":"2124cf41-0aea-4909-8c16-9def6fb8bff2","Type":"ContainerStarted","Data":"6843717896f4e87209ed46dc3d5acf10bf1c8ccde5d24e8e98e812e8773858cb"}
Jul 09 18:15:26.032296 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:26.032277    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63aaf52299619b7c3bf2861deba6ce0c21c2f23a360ae68dfdf6233bfaca1b3a"
Jul 09 18:15:26.032296 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:26.032283    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:26.043373 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:15:26.043346    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7170-140264194474032\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="5c228385-5dae-4ce4-9214-7ed7075be8d8" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:26.669895 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:15:26.669858    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7170-140264194474032\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="5c228385-5dae-4ce4-9214-7ed7075be8d8" pod="openshift-ingress/test-curl-7170-140264194474032"
Jul 09 18:15:26.671022 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:26.670994    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c228385-5dae-4ce4-9214-7ed7075be8d8" path="/var/lib/kubelet/pods/5c228385-5dae-4ce4-9214-7ed7075be8d8/volumes"
Jul 09 18:15:27.039317 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:27.039241    2583 generic.go:356] "Generic (PLEG): container finished" podID="2124cf41-0aea-4909-8c16-9def6fb8bff2" containerID="4feac8db514b7d138ab80b2a08c5e79286e5ee6bebecedadbaacd9fb22a48e3c" exitCode=0
Jul 09 18:15:27.039469 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:27.039327    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194474896" event={"ID":"2124cf41-0aea-4909-8c16-9def6fb8bff2","Type":"ContainerDied","Data":"4feac8db514b7d138ab80b2a08c5e79286e5ee6bebecedadbaacd9fb22a48e3c"}
Jul 09 18:15:28.195402 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.195373    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:28.216306 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.216276    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7170-140264194474896_2124cf41-0aea-4909-8c16-9def6fb8bff2/test-curl-7170-140264194474896/0.log"
Jul 09 18:15:28.240166 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.240145    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:28.243414 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.243394    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:28.260212 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.260185    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7tmz\" (UniqueName: \"kubernetes.io/projected/2124cf41-0aea-4909-8c16-9def6fb8bff2-kube-api-access-h7tmz\") pod \"2124cf41-0aea-4909-8c16-9def6fb8bff2\" (UID: \"2124cf41-0aea-4909-8c16-9def6fb8bff2\") "
Jul 09 18:15:28.262072 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.262051    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2124cf41-0aea-4909-8c16-9def6fb8bff2-kube-api-access-h7tmz" (OuterVolumeSpecName: "kube-api-access-h7tmz") pod "2124cf41-0aea-4909-8c16-9def6fb8bff2" (UID: "2124cf41-0aea-4909-8c16-9def6fb8bff2"). InnerVolumeSpecName "kube-api-access-h7tmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:15:28.361152 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.361130    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7tmz\" (UniqueName: \"kubernetes.io/projected/2124cf41-0aea-4909-8c16-9def6fb8bff2-kube-api-access-h7tmz\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:28.375265 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.375239    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:28.375624 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.375610    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2124cf41-0aea-4909-8c16-9def6fb8bff2" containerName="test-curl-7170-140264194474896"
Jul 09 18:15:28.375685 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.375625    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2124cf41-0aea-4909-8c16-9def6fb8bff2" containerName="test-curl-7170-140264194474896"
Jul 09 18:15:28.375728 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.375696    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2124cf41-0aea-4909-8c16-9def6fb8bff2" containerName="test-curl-7170-140264194474896"
Jul 09 18:15:28.378624 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.378608    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:28.383014 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.382991    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:28.462373 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.462348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4zg9\" (UniqueName: \"kubernetes.io/projected/c995ff6a-17dd-4251-84d6-8808817177d9-kube-api-access-f4zg9\") pod \"test-curl-7170-140264194474896\" (UID: \"c995ff6a-17dd-4251-84d6-8808817177d9\") " pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:28.563184 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.563152    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4zg9\" (UniqueName: \"kubernetes.io/projected/c995ff6a-17dd-4251-84d6-8808817177d9-kube-api-access-f4zg9\") pod \"test-curl-7170-140264194474896\" (UID: \"c995ff6a-17dd-4251-84d6-8808817177d9\") " pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:28.571344 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.571320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4zg9\" (UniqueName: \"kubernetes.io/projected/c995ff6a-17dd-4251-84d6-8808817177d9-kube-api-access-f4zg9\") pod \"test-curl-7170-140264194474896\" (UID: \"c995ff6a-17dd-4251-84d6-8808817177d9\") " pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:28.670706 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.670630    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2124cf41-0aea-4909-8c16-9def6fb8bff2" path="/var/lib/kubelet/pods/2124cf41-0aea-4909-8c16-9def6fb8bff2/volumes"
Jul 09 18:15:28.688812 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.688789    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:28.817592 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:28.817566    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:28.818495 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:15:28.818471    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc995ff6a_17dd_4251_84d6_8808817177d9.slice/crio-bb36745ece17938339fe696b1a34f8950121b7a852125feb034b030e970ee595 WatchSource:0}: Error finding container bb36745ece17938339fe696b1a34f8950121b7a852125feb034b030e970ee595: Status 404 returned error can't find the container with id bb36745ece17938339fe696b1a34f8950121b7a852125feb034b030e970ee595
Jul 09 18:15:29.050744 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:29.050672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194474896" event={"ID":"c995ff6a-17dd-4251-84d6-8808817177d9","Type":"ContainerStarted","Data":"bb36745ece17938339fe696b1a34f8950121b7a852125feb034b030e970ee595"}
Jul 09 18:15:29.051758 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:29.051736    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:29.051856 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:29.051781    2583 scope.go:117] "RemoveContainer" containerID="4feac8db514b7d138ab80b2a08c5e79286e5ee6bebecedadbaacd9fb22a48e3c"
Jul 09 18:15:30.058767 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:30.058736    2583 generic.go:356] "Generic (PLEG): container finished" podID="c995ff6a-17dd-4251-84d6-8808817177d9" containerID="90a58e543981f2366814e2b689a9b2a10dcfe43b10bc88b875ee2030a27f6a76" exitCode=0
Jul 09 18:15:30.059181 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:30.058819    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7170-140264194474896" event={"ID":"c995ff6a-17dd-4251-84d6-8808817177d9","Type":"ContainerDied","Data":"90a58e543981f2366814e2b689a9b2a10dcfe43b10bc88b875ee2030a27f6a76"}
Jul 09 18:15:31.201510 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:31.201486    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:31.222055 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:31.222037    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7170-140264194474896_c995ff6a-17dd-4251-84d6-8808817177d9/test-curl-7170-140264194474896/0.log"
Jul 09 18:15:31.243899 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:31.243876    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:31.249272 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:31.249247    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7170-140264194474896"]
Jul 09 18:15:31.286375 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:31.286355    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4zg9\" (UniqueName: \"kubernetes.io/projected/c995ff6a-17dd-4251-84d6-8808817177d9-kube-api-access-f4zg9\") pod \"c995ff6a-17dd-4251-84d6-8808817177d9\" (UID: \"c995ff6a-17dd-4251-84d6-8808817177d9\") "
Jul 09 18:15:31.288334 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:31.288307    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c995ff6a-17dd-4251-84d6-8808817177d9-kube-api-access-f4zg9" (OuterVolumeSpecName: "kube-api-access-f4zg9") pod "c995ff6a-17dd-4251-84d6-8808817177d9" (UID: "c995ff6a-17dd-4251-84d6-8808817177d9"). InnerVolumeSpecName "kube-api-access-f4zg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:15:31.387441 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:31.387416    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4zg9\" (UniqueName: \"kubernetes.io/projected/c995ff6a-17dd-4251-84d6-8808817177d9-kube-api-access-f4zg9\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:15:31.585631 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:31.585606    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:31.936495 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:31.936467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:32.035451 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:32.035422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:32.071145 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:32.071124    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:32.071145 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:32.071140    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb36745ece17938339fe696b1a34f8950121b7a852125feb034b030e970ee595"
Jul 09 18:15:32.081176 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:15:32.081151    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7170-140264194474896\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="c995ff6a-17dd-4251-84d6-8808817177d9" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:32.134595 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:32.134560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:32.243778 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:32.243703    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"]
Jul 09 18:15:32.244175 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:32.243916    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh" podUID="aff57827-8b34-4ea1-95a0-7e26a9758096" containerName="cleanup" containerID="cri-o://ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1" gracePeriod=30
Jul 09 18:15:32.253239 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:32.253182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:32.271180 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:15:32.271154    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7170-140264194474896\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="c995ff6a-17dd-4251-84d6-8808817177d9" pod="openshift-ingress/test-curl-7170-140264194474896"
Jul 09 18:15:32.670073 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:32.670045    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c995ff6a-17dd-4251-84d6-8808817177d9" path="/var/lib/kubelet/pods/c995ff6a-17dd-4251-84d6-8808817177d9/volumes"
Jul 09 18:15:37.012119 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:37.012085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:37.111598 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:37.111566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:38.060717 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:38.060683    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:38.165178 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:38.165152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:38.351047 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:38.351020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:38.584244 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:38.584194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:38.773111 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:38.773040    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:39.183564 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:39.183530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:39.285888 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:39.285852    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:39.386292 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:39.386264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:39.472957 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:39.472887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:39.481713 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:39.481687    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"]
Jul 09 18:15:39.481918 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:39.481896    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459" podUID="0c31a799-cbfb-4432-933f-0a4ce7eb96ca" containerName="cleanup" containerID="cri-o://2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f" gracePeriod=30
Jul 09 18:15:45.426953 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:45.426922    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:45.498688 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:45.498654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:45.715091 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:45.715013    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:45.948895 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:45.948853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:15:46.403615 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:46.403571    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c8bd9df76-scqq4_a5e64bc7-a504-4a91-aa40-f3b2e8e37930/authorino/0.log"
Jul 09 18:15:51.842138 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:51.842062    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c99kv_d065ce89-754a-4bf9-a188-5cecf6597d47/server/0.log"
Jul 09 18:15:51.969300 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:51.969275    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rxl9l_9eab3ad5-4245-447f-b1c5-a0cc2380d87c/manager/0.log"
Jul 09 18:15:52.352129 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:52.352105    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c8444b686-vsw6g_12fc840b-d09a-42f9-8e89-f84559747e59/copy-manifests/0.log"
Jul 09 18:15:52.358766 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:52.358742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c8444b686-vsw6g_12fc840b-d09a-42f9-8e89-f84559747e59/manager/0.log"
Jul 09 18:15:52.858039 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:52.858014    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29727015-9b2gk_49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0/cleanup/0.log"
Jul 09 18:15:52.984572 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:52.984549    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh_aff57827-8b34-4ea1-95a0-7e26a9758096/cleanup/0.log"
Jul 09 18:15:53.105235 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:53.105194    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459_0c31a799-cbfb-4432-933f-0a4ce7eb96ca/cleanup/0.log"
Jul 09 18:15:54.064023 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.063992    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x_1516a191-a298-4f57-a233-9e6617d9e684/util/0.log"
Jul 09 18:15:54.070249 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.070226    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x_1516a191-a298-4f57-a233-9e6617d9e684/pull/0.log"
Jul 09 18:15:54.076373 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.076352    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x_1516a191-a298-4f57-a233-9e6617d9e684/extract/0.log"
Jul 09 18:15:54.196731 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.196709    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2_fef2f356-1df5-4cc0-9599-2b3a973beb12/util/0.log"
Jul 09 18:15:54.203511 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.203491    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2_fef2f356-1df5-4cc0-9599-2b3a973beb12/pull/0.log"
Jul 09 18:15:54.209689 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.209671    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2_fef2f356-1df5-4cc0-9599-2b3a973beb12/extract/0.log"
Jul 09 18:15:54.326539 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.326470    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5_4e5e89a1-27bb-4a9b-8a9b-13c316b88a41/util/0.log"
Jul 09 18:15:54.332957 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.332937    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5_4e5e89a1-27bb-4a9b-8a9b-13c316b88a41/pull/0.log"
Jul 09 18:15:54.341089 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.341071    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5_4e5e89a1-27bb-4a9b-8a9b-13c316b88a41/extract/0.log"
Jul 09 18:15:54.455890 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.455864    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j_18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2/util/0.log"
Jul 09 18:15:54.461459 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.461439    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j_18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2/pull/0.log"
Jul 09 18:15:54.467006 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.466987    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j_18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2/extract/0.log"
Jul 09 18:15:54.590543 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.590524    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c8bd9df76-scqq4_a5e64bc7-a504-4a91-aa40-f3b2e8e37930/authorino/0.log"
Jul 09 18:15:54.836382 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.836348    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jcdb7_04e9a411-8b2a-4b84-af42-315712aa4830/manager/0.log"
Jul 09 18:15:54.950434 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:54.950358    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cjp9x_893929af-f365-4d41-9444-4108e200970f/kuadrant-console-plugin/0.log"
Jul 09 18:15:56.221215 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:56.221184    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cbbdb477-zgzdg_4a5b1c77-0e75-4bd1-927c-249c40beeca6/kube-auth-proxy/0.log"
Jul 09 18:15:56.475535 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:56.475450    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-brzrj_dc167e09-6c38-4d5b-8eb1-dfdda59b204c/payload-pre-processing/0.log"
Jul 09 18:15:56.597398 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:56.597372    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-nlhcd_ad473846-6c22-491a-85c7-fa6478b7edc5/payload-processing/0.log"
Jul 09 18:15:57.203971 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:57.203901    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qbgwv_0282b38b-173c-424c-8b9d-5a2491b32321/main/0.log"
Jul 09 18:15:57.456870 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:15:57.456800    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhcsgw_d492bbc2-160e-49a1-b113-3f6b9cd8a7b4/main/0.log"
Jul 09 18:16:00.012104 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:00.012068    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"]
Jul 09 18:16:00.012546 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:00.012285    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk" podUID="49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0" containerName="cleanup" containerID="cri-o://d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68" gracePeriod=30
Jul 09 18:16:01.746767 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.746733    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4w85k/must-gather-n2h8p"]
Jul 09 18:16:01.748213 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.748168    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c995ff6a-17dd-4251-84d6-8808817177d9" containerName="test-curl-7170-140264194474896"
Jul 09 18:16:01.748361 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.748348    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c995ff6a-17dd-4251-84d6-8808817177d9" containerName="test-curl-7170-140264194474896"
Jul 09 18:16:01.748657 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.748620    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c995ff6a-17dd-4251-84d6-8808817177d9" containerName="test-curl-7170-140264194474896"
Jul 09 18:16:01.754759 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.754739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w85k/must-gather-n2h8p"
Jul 09 18:16:01.758901 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.758878    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4w85k\"/\"kube-root-ca.crt\""
Jul 09 18:16:01.759548 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.759503    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:16:01.760104 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.760079    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w85k/must-gather-n2h8p"]
Jul 09 18:16:01.760369 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.760351    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4w85k\"/\"default-dockercfg-vct85\""
Jul 09 18:16:01.760467 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.760397    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4w85k\"/\"openshift-service-ca.crt\""
Jul 09 18:16:01.827391 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.827369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c68f729c-87bc-4bc6-95ba-30a56d01dc0f-must-gather-output\") pod \"must-gather-n2h8p\" (UID: \"c68f729c-87bc-4bc6-95ba-30a56d01dc0f\") " pod="openshift-must-gather-4w85k/must-gather-n2h8p"
Jul 09 18:16:01.827496 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.827466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd2qz\" (UniqueName: \"kubernetes.io/projected/c68f729c-87bc-4bc6-95ba-30a56d01dc0f-kube-api-access-zd2qz\") pod \"must-gather-n2h8p\" (UID: \"c68f729c-87bc-4bc6-95ba-30a56d01dc0f\") " pod="openshift-must-gather-4w85k/must-gather-n2h8p"
Jul 09 18:16:01.854274 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.854247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log" limit=1024
Jul 09 18:16:01.928529 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.928506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c68f729c-87bc-4bc6-95ba-30a56d01dc0f-must-gather-output\") pod \"must-gather-n2h8p\" (UID: \"c68f729c-87bc-4bc6-95ba-30a56d01dc0f\") " pod="openshift-must-gather-4w85k/must-gather-n2h8p"
Jul 09 18:16:01.928650 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.928590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd2qz\" (UniqueName: \"kubernetes.io/projected/c68f729c-87bc-4bc6-95ba-30a56d01dc0f-kube-api-access-zd2qz\") pod \"must-gather-n2h8p\" (UID: \"c68f729c-87bc-4bc6-95ba-30a56d01dc0f\") " pod="openshift-must-gather-4w85k/must-gather-n2h8p"
Jul 09 18:16:01.928815 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.928795    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c68f729c-87bc-4bc6-95ba-30a56d01dc0f-must-gather-output\") pod \"must-gather-n2h8p\" (UID: \"c68f729c-87bc-4bc6-95ba-30a56d01dc0f\") " pod="openshift-must-gather-4w85k/must-gather-n2h8p"
Jul 09 18:16:01.936958 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:01.936931    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd2qz\" (UniqueName: \"kubernetes.io/projected/c68f729c-87bc-4bc6-95ba-30a56d01dc0f-kube-api-access-zd2qz\") pod \"must-gather-n2h8p\" (UID: \"c68f729c-87bc-4bc6-95ba-30a56d01dc0f\") " pod="openshift-must-gather-4w85k/must-gather-n2h8p"
Jul 09 18:16:02.065350 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:02.065301    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w85k/must-gather-n2h8p"
Jul 09 18:16:02.198258 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:02.198226    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w85k/must-gather-n2h8p"]
Jul 09 18:16:02.199697 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:16:02.199671    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc68f729c_87bc_4bc6_95ba_30a56d01dc0f.slice/crio-0798b5301287dc16f3cafbac37012b8a0131b47ff04e54baa5c166cb3027af54 WatchSource:0}: Error finding container 0798b5301287dc16f3cafbac37012b8a0131b47ff04e54baa5c166cb3027af54: Status 404 returned error can't find the container with id 0798b5301287dc16f3cafbac37012b8a0131b47ff04e54baa5c166cb3027af54
Jul 09 18:16:02.229745 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:02.229718    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w85k/must-gather-n2h8p" event={"ID":"c68f729c-87bc-4bc6-95ba-30a56d01dc0f","Type":"ContainerStarted","Data":"0798b5301287dc16f3cafbac37012b8a0131b47ff04e54baa5c166cb3027af54"}
Jul 09 18:16:02.416793 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:02.416770    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"
Jul 09 18:16:02.431981 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:02.431962    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9mxv\" (UniqueName: \"kubernetes.io/projected/aff57827-8b34-4ea1-95a0-7e26a9758096-kube-api-access-f9mxv\") pod \"aff57827-8b34-4ea1-95a0-7e26a9758096\" (UID: \"aff57827-8b34-4ea1-95a0-7e26a9758096\") "
Jul 09 18:16:02.433871 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:02.433850    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff57827-8b34-4ea1-95a0-7e26a9758096-kube-api-access-f9mxv" (OuterVolumeSpecName: "kube-api-access-f9mxv") pod "aff57827-8b34-4ea1-95a0-7e26a9758096" (UID: "aff57827-8b34-4ea1-95a0-7e26a9758096"). InnerVolumeSpecName "kube-api-access-f9mxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:16:02.532952 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:02.532924    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9mxv\" (UniqueName: \"kubernetes.io/projected/aff57827-8b34-4ea1-95a0-7e26a9758096-kube-api-access-f9mxv\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:16:03.239109 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.239017    2583 generic.go:356] "Generic (PLEG): container finished" podID="aff57827-8b34-4ea1-95a0-7e26a9758096" containerID="ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1" exitCode=137
Jul 09 18:16:03.239585 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.239165    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"
Jul 09 18:16:03.239682 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.239659    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh" event={"ID":"aff57827-8b34-4ea1-95a0-7e26a9758096","Type":"ContainerDied","Data":"ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1"}
Jul 09 18:16:03.239753 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.239718    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh" event={"ID":"aff57827-8b34-4ea1-95a0-7e26a9758096","Type":"ContainerDied","Data":"5d69d7b31beb6802c2ac5c2b631698ffdf44ddfcc798f1145c7b7110a87181e7"}
Jul 09 18:16:03.239819 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.239754    2583 scope.go:117] "RemoveContainer" containerID="ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1"
Jul 09 18:16:03.242233 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.242182    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w85k/must-gather-n2h8p" event={"ID":"c68f729c-87bc-4bc6-95ba-30a56d01dc0f","Type":"ContainerStarted","Data":"958a6455b63f9486c99e9a74ddec9bd5c1813b6fcc963d69206c3ef0c7752f05"}
Jul 09 18:16:03.242345 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.242252    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w85k/must-gather-n2h8p" event={"ID":"c68f729c-87bc-4bc6-95ba-30a56d01dc0f","Type":"ContainerStarted","Data":"8fa2e2a33150c7d58bb2df87756c35c883ef0f48d80aa5b9ae40ea5df81751d6"}
Jul 09 18:16:03.253111 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.253067    2583 scope.go:117] "RemoveContainer" containerID="ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1"
Jul 09 18:16:03.253511 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:16:03.253445    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1\": container with ID starting with ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1 not found: ID does not exist" containerID="ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1"
Jul 09 18:16:03.253511 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.253481    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1"} err="failed to get container status \"ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1\": rpc error: code = NotFound desc = could not find container \"ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1\": container with ID starting with ac518a0db5222d78203bb98b51b25f128a7090d1eef0602e1bc656b0e59850f1 not found: ID does not exist"
Jul 09 18:16:03.259177 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.259151    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"]
Jul 09 18:16:03.262821 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.262799    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-09d279-29727015-lpcwh"]
Jul 09 18:16:03.277968 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:03.277927    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4w85k/must-gather-n2h8p" podStartSLOduration=1.649120921 podStartE2EDuration="2.277912572s" totalImagesPullingTime="628.791651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:16:03.276565261 +0000 UTC m=+2887.059284591" watchObservedRunningTime="2026-07-09 18:16:03.277912572 +0000 UTC m=+2887.060631938"
Jul 09 18:16:04.391647 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:04.391616    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2d4dg_3c6c2219-d209-4d94-a17e-5eb6baa05c02/global-pull-secret-syncer/0.log"
Jul 09 18:16:04.534844 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:04.534812    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4pnt6_817a083d-1599-4594-acf4-4c6548882747/konnectivity-agent/0.log"
Jul 09 18:16:04.632671 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:04.632635    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-85.ec2.internal_b91921211232e6c562c46bbcbbc9ca7e/haproxy/0.log"
Jul 09 18:16:04.672570 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:04.672499    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff57827-8b34-4ea1-95a0-7e26a9758096" path="/var/lib/kubelet/pods/aff57827-8b34-4ea1-95a0-7e26a9758096/volumes"
Jul 09 18:16:09.504291 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.504127    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x_1516a191-a298-4f57-a233-9e6617d9e684/extract/0.log"
Jul 09 18:16:09.526841 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.526726    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x_1516a191-a298-4f57-a233-9e6617d9e684/util/0.log"
Jul 09 18:16:09.548141 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.548104    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qbt7x_1516a191-a298-4f57-a233-9e6617d9e684/pull/0.log"
Jul 09 18:16:09.587219 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.587062    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2_fef2f356-1df5-4cc0-9599-2b3a973beb12/extract/0.log"
Jul 09 18:16:09.617425 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.617063    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2_fef2f356-1df5-4cc0-9599-2b3a973beb12/util/0.log"
Jul 09 18:16:09.702658 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.699397    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w95k2_fef2f356-1df5-4cc0-9599-2b3a973beb12/pull/0.log"
Jul 09 18:16:09.728219 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.728042    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5_4e5e89a1-27bb-4a9b-8a9b-13c316b88a41/extract/0.log"
Jul 09 18:16:09.764260 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.760228    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5_4e5e89a1-27bb-4a9b-8a9b-13c316b88a41/util/0.log"
Jul 09 18:16:09.789789 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.789752    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73n4ds5_4e5e89a1-27bb-4a9b-8a9b-13c316b88a41/pull/0.log"
Jul 09 18:16:09.817187 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.816362    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j_18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2/extract/0.log"
Jul 09 18:16:09.819910 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.819688    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"
Jul 09 18:16:09.841959 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.841780    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j_18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2/util/0.log"
Jul 09 18:16:09.871576 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.871505    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dgh4j_18c9f4ce-ecc2-4a27-828f-82fbbf02b4b2/pull/0.log"
Jul 09 18:16:09.904238 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.903967    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcl4x\" (UniqueName: \"kubernetes.io/projected/0c31a799-cbfb-4432-933f-0a4ce7eb96ca-kube-api-access-hcl4x\") pod \"0c31a799-cbfb-4432-933f-0a4ce7eb96ca\" (UID: \"0c31a799-cbfb-4432-933f-0a4ce7eb96ca\") "
Jul 09 18:16:09.907295 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:09.907127    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c31a799-cbfb-4432-933f-0a4ce7eb96ca-kube-api-access-hcl4x" (OuterVolumeSpecName: "kube-api-access-hcl4x") pod "0c31a799-cbfb-4432-933f-0a4ce7eb96ca" (UID: "0c31a799-cbfb-4432-933f-0a4ce7eb96ca"). InnerVolumeSpecName "kube-api-access-hcl4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:16:10.008542 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.007350    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcl4x\" (UniqueName: \"kubernetes.io/projected/0c31a799-cbfb-4432-933f-0a4ce7eb96ca-kube-api-access-hcl4x\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:16:10.257224 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.257042    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c8bd9df76-scqq4_a5e64bc7-a504-4a91-aa40-f3b2e8e37930/authorino/0.log"
Jul 09 18:16:10.312591 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.312558    2583 generic.go:356] "Generic (PLEG): container finished" podID="0c31a799-cbfb-4432-933f-0a4ce7eb96ca" containerID="2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f" exitCode=137
Jul 09 18:16:10.312780 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.312646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459" event={"ID":"0c31a799-cbfb-4432-933f-0a4ce7eb96ca","Type":"ContainerDied","Data":"2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f"}
Jul 09 18:16:10.312780 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.312726    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459" event={"ID":"0c31a799-cbfb-4432-933f-0a4ce7eb96ca","Type":"ContainerDied","Data":"65cb43eb3e53669fc50af3f5f5d0ecdeaacfb26807d7b39ebaf49be49891ffd7"}
Jul 09 18:16:10.312780 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.312751    2583 scope.go:117] "RemoveContainer" containerID="2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f"
Jul 09 18:16:10.312965 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.312893    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"
Jul 09 18:16:10.319665 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.318700    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jcdb7_04e9a411-8b2a-4b84-af42-315712aa4830/manager/0.log"
Jul 09 18:16:10.329397 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.329037    2583 scope.go:117] "RemoveContainer" containerID="2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f"
Jul 09 18:16:10.329551 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:16:10.329442    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f\": container with ID starting with 2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f not found: ID does not exist" containerID="2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f"
Jul 09 18:16:10.329551 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.329480    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f"} err="failed to get container status \"2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f\": rpc error: code = NotFound desc = could not find container \"2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f\": container with ID starting with 2229250dcec2e2fd736df6cf22e4e66754117b539908d8d09561edb184ecc34f not found: ID does not exist"
Jul 09 18:16:10.344570 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.344535    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"]
Jul 09 18:16:10.348277 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.348251    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e0b9f9-29727015-sc459"]
Jul 09 18:16:10.352650 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.352626    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cjp9x_893929af-f365-4d41-9444-4108e200970f/kuadrant-console-plugin/0.log"
Jul 09 18:16:10.673983 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:10.673942    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c31a799-cbfb-4432-933f-0a4ce7eb96ca" path="/var/lib/kubelet/pods/0c31a799-cbfb-4432-933f-0a4ce7eb96ca/volumes"
Jul 09 18:16:12.466229 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:12.466174    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-655cb869dd-l8tcr_5e6ee9bc-94ec-4933-9e92-fa4f0c9ecf1f/metrics-server/0.log"
Jul 09 18:16:12.683335 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:12.683302    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4pgb_d3aab060-d298-416e-8288-06fbbc402178/node-exporter/0.log"
Jul 09 18:16:12.704245 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:12.704222    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4pgb_d3aab060-d298-416e-8288-06fbbc402178/kube-rbac-proxy/0.log"
Jul 09 18:16:12.726187 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:12.726112    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4pgb_d3aab060-d298-416e-8288-06fbbc402178/init-textfile/0.log"
Jul 09 18:16:13.039937 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:13.039838    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-7v978_ace96505-87af-4160-92b0-8fe2e52caa57/prometheus-operator-admission-webhook/0.log"
Jul 09 18:16:13.136411 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:13.136383    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645b54c9f5-tnc9j_3f70cf43-9ebd-46cf-9ee3-6694dcbda453/thanos-query/0.log"
Jul 09 18:16:13.156321 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:13.156297    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645b54c9f5-tnc9j_3f70cf43-9ebd-46cf-9ee3-6694dcbda453/kube-rbac-proxy-web/0.log"
Jul 09 18:16:13.181569 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:13.181541    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645b54c9f5-tnc9j_3f70cf43-9ebd-46cf-9ee3-6694dcbda453/kube-rbac-proxy/0.log"
Jul 09 18:16:13.200883 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:13.200852    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645b54c9f5-tnc9j_3f70cf43-9ebd-46cf-9ee3-6694dcbda453/prom-label-proxy/0.log"
Jul 09 18:16:13.220725 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:13.220702    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645b54c9f5-tnc9j_3f70cf43-9ebd-46cf-9ee3-6694dcbda453/kube-rbac-proxy-rules/0.log"
Jul 09 18:16:13.240794 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:13.240767    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-645b54c9f5-tnc9j_3f70cf43-9ebd-46cf-9ee3-6694dcbda453/kube-rbac-proxy-metrics/0.log"
Jul 09 18:16:14.645777 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.645727    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"]
Jul 09 18:16:14.646718 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.646689    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff57827-8b34-4ea1-95a0-7e26a9758096" containerName="cleanup"
Jul 09 18:16:14.646718 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.646715    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff57827-8b34-4ea1-95a0-7e26a9758096" containerName="cleanup"
Jul 09 18:16:14.646906 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.646733    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c31a799-cbfb-4432-933f-0a4ce7eb96ca" containerName="cleanup"
Jul 09 18:16:14.646906 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.646738    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c31a799-cbfb-4432-933f-0a4ce7eb96ca" containerName="cleanup"
Jul 09 18:16:14.646906 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.646804    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff57827-8b34-4ea1-95a0-7e26a9758096" containerName="cleanup"
Jul 09 18:16:14.646906 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.646814    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c31a799-cbfb-4432-933f-0a4ce7eb96ca" containerName="cleanup"
Jul 09 18:16:14.651805 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.651734    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.663224 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.663182    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"]
Jul 09 18:16:14.753235 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.753179    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-sys\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.753428 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.753257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-lib-modules\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.753428 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.753290    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rnk7\" (UniqueName: \"kubernetes.io/projected/fc353e1b-09cd-4382-ad80-5bd161b34ffc-kube-api-access-2rnk7\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.753428 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.753323    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-proc\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.753428 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.753379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-podres\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.854496 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.854458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-sys\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.854692 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.854512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-lib-modules\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.854692 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.854545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rnk7\" (UniqueName: \"kubernetes.io/projected/fc353e1b-09cd-4382-ad80-5bd161b34ffc-kube-api-access-2rnk7\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.854692 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.854582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-proc\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.854692 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.854624    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-podres\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.854920 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.854765    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-podres\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.854920 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.854805    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-sys\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.854920 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.854865    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-lib-modules\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.855160 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.855126    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc353e1b-09cd-4382-ad80-5bd161b34ffc-proc\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.865154 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.865124    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rnk7\" (UniqueName: \"kubernetes.io/projected/fc353e1b-09cd-4382-ad80-5bd161b34ffc-kube-api-access-2rnk7\") pod \"perf-node-gather-daemonset-xchsn\" (UID: \"fc353e1b-09cd-4382-ad80-5bd161b34ffc\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:14.966161 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:14.966070    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:15.147001 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:15.146968    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"]
Jul 09 18:16:15.149362 ip-10-0-129-85 kubenswrapper[2583]: W0709 18:16:15.149339    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc353e1b_09cd_4382_ad80_5bd161b34ffc.slice/crio-7ad68b8c22542d3a9009aed1638b6223534c73fb1b98b0d755f59fe355831c9c WatchSource:0}: Error finding container 7ad68b8c22542d3a9009aed1638b6223534c73fb1b98b0d755f59fe355831c9c: Status 404 returned error can't find the container with id 7ad68b8c22542d3a9009aed1638b6223534c73fb1b98b0d755f59fe355831c9c
Jul 09 18:16:15.358560 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:15.358357    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn" event={"ID":"fc353e1b-09cd-4382-ad80-5bd161b34ffc","Type":"ContainerStarted","Data":"c4b55d9e6a9854f1d305131c7cd7c59df41f5f12d0f89565db39a0bfa9c0b7bc"}
Jul 09 18:16:15.358560 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:15.358427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn" event={"ID":"fc353e1b-09cd-4382-ad80-5bd161b34ffc","Type":"ContainerStarted","Data":"7ad68b8c22542d3a9009aed1638b6223534c73fb1b98b0d755f59fe355831c9c"}
Jul 09 18:16:15.358793 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:15.358617    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:15.377427 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:15.377381    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn" podStartSLOduration=1.37736716 podStartE2EDuration="1.37736716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:16:15.376182759 +0000 UTC m=+2899.158902091" watchObservedRunningTime="2026-07-09 18:16:15.37736716 +0000 UTC m=+2899.160086490"
Jul 09 18:16:15.480303 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:15.480230    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557d78b4cd-dssc9_5929675a-53ae-4a84-a3c0-8f8c475993b6/console/0.log"
Jul 09 18:16:15.513925 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:15.513901    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-gwcbw_b76ff92a-a229-4bc9-8e47-bd6874831f96/download-server/0.log"
Jul 09 18:16:17.064472 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:17.064423    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kbmjn_47f6b04e-8b09-4796-82bb-e4627482008b/dns/0.log"
Jul 09 18:16:17.097684 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:17.097660    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kbmjn_47f6b04e-8b09-4796-82bb-e4627482008b/kube-rbac-proxy/0.log"
Jul 09 18:16:17.228111 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:17.228088    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59fkz_db60da2c-6cce-408a-9bc4-923b9ea3a79f/dns-node-resolver/0.log"
Jul 09 18:16:17.802187 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:17.802160    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d7cb5cb77-b5vb7_0579787e-b1f9-47a1-9676-9b90f869bb1e/registry/0.log"
Jul 09 18:16:17.824324 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:17.824299    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-62pn5_428cf71a-d839-4997-9aec-614cedd0bf3d/node-ca/0.log"
Jul 09 18:16:18.947814 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:18.947768    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cbbdb477-zgzdg_4a5b1c77-0e75-4bd1-927c-249c40beeca6/kube-auth-proxy/0.log"
Jul 09 18:16:19.053066 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:19.053036    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-brzrj_dc167e09-6c38-4d5b-8eb1-dfdda59b204c/payload-pre-processing/0.log"
Jul 09 18:16:19.114628 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:19.114585    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-nlhcd_ad473846-6c22-491a-85c7-fa6478b7edc5/payload-processing/0.log"
Jul 09 18:16:19.879680 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:19.879654    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tft5v_91301d75-2ad2-455d-bf20-237cd3d050d0/serve-healthcheck-canary/0.log"
Jul 09 18:16:20.589382 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:20.589357    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mm4v5_4551c739-ce40-4612-98a8-a498cc87b5db/kube-rbac-proxy/0.log"
Jul 09 18:16:20.611737 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:20.611713    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mm4v5_4551c739-ce40-4612-98a8-a498cc87b5db/exporter/0.log"
Jul 09 18:16:20.633569 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:20.633548    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mm4v5_4551c739-ce40-4612-98a8-a498cc87b5db/extractor/0.log"
Jul 09 18:16:21.376578 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:21.376549    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-xchsn"
Jul 09 18:16:23.144147 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:23.144117    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c99kv_d065ce89-754a-4bf9-a188-5cecf6597d47/server/0.log"
Jul 09 18:16:23.234814 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:23.234786    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rxl9l_9eab3ad5-4245-447f-b1c5-a0cc2380d87c/manager/0.log"
Jul 09 18:16:23.431857 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:23.431781    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c8444b686-vsw6g_12fc840b-d09a-42f9-8e89-f84559747e59/manager/0.log"
Jul 09 18:16:23.461963 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:23.461934    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c8444b686-vsw6g_12fc840b-d09a-42f9-8e89-f84559747e59/copy-manifests/0.log"
Jul 09 18:16:24.692709 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:24.692670    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cbbdb477-zgzdg_4a5b1c77-0e75-4bd1-927c-249c40beeca6/kube-auth-proxy/0.log"
Jul 09 18:16:24.777189 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:24.777154    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-brzrj_dc167e09-6c38-4d5b-8eb1-dfdda59b204c/payload-pre-processing/0.log"
Jul 09 18:16:24.821966 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:24.821935    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-nlhcd_ad473846-6c22-491a-85c7-fa6478b7edc5/payload-processing/0.log"
Jul 09 18:16:24.864880 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:24.864855    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6784c458c5-s8pqs_b3132994-1f76-4c94-b165-8f55ddb421a9/manager/0.log"
Jul 09 18:16:26.171217 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:26.171173    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cbbdb477-zgzdg_4a5b1c77-0e75-4bd1-927c-249c40beeca6/kube-auth-proxy/0.log"
Jul 09 18:16:26.260214 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:26.260165    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-brzrj_dc167e09-6c38-4d5b-8eb1-dfdda59b204c/payload-pre-processing/0.log"
Jul 09 18:16:26.309466 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:26.309433    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-nlhcd_ad473846-6c22-491a-85c7-fa6478b7edc5/payload-processing/0.log"
Jul 09 18:16:30.268511 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.268403    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"
Jul 09 18:16:30.405006 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.404976    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvc6n\" (UniqueName: \"kubernetes.io/projected/49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0-kube-api-access-dvc6n\") pod \"49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0\" (UID: \"49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0\") "
Jul 09 18:16:30.407578 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.407546    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0-kube-api-access-dvc6n" (OuterVolumeSpecName: "kube-api-access-dvc6n") pod "49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0" (UID: "49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0"). InnerVolumeSpecName "kube-api-access-dvc6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:16:30.470795 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.470753    2583 generic.go:356] "Generic (PLEG): container finished" podID="49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0" containerID="d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68" exitCode=137
Jul 09 18:16:30.470984 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.470846    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"
Jul 09 18:16:30.470984 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.470889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk" event={"ID":"49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0","Type":"ContainerDied","Data":"d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68"}
Jul 09 18:16:30.470984 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.470939    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk" event={"ID":"49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0","Type":"ContainerDied","Data":"950c05a95ecf96c7b06e789cd4e98c30606c9a103553ab5bd4bf6bfce9a422f5"}
Jul 09 18:16:30.470984 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.470960    2583 scope.go:117] "RemoveContainer" containerID="d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68"
Jul 09 18:16:30.482412 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.482394    2583 scope.go:117] "RemoveContainer" containerID="d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68"
Jul 09 18:16:30.483077 ip-10-0-129-85 kubenswrapper[2583]: E0709 18:16:30.483047    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68\": container with ID starting with d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68 not found: ID does not exist" containerID="d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68"
Jul 09 18:16:30.483177 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.483090    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68"} err="failed to get container status \"d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68\": rpc error: code = NotFound desc = could not find container \"d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68\": container with ID starting with d704c30965d7e53706791187c543a968eeb1584a3598ed1d246dd75627630f68 not found: ID does not exist"
Jul 09 18:16:30.498434 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.498408    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"]
Jul 09 18:16:30.500776 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.500756    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727015-9b2gk"]
Jul 09 18:16:30.505717 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.505694    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvc6n\" (UniqueName: \"kubernetes.io/projected/49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0-kube-api-access-dvc6n\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\""
Jul 09 18:16:30.670088 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:30.670059    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0" path="/var/lib/kubelet/pods/49a7ac9b-19fa-40e1-9e12-0e7a504ad4f0/volumes"
Jul 09 18:16:31.427182 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.427159    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pnrtm_28f05b04-e9c8-40cc-a1a9-506eda546585/kube-multus-additional-cni-plugins/0.log"
Jul 09 18:16:31.451562 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.451532    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pnrtm_28f05b04-e9c8-40cc-a1a9-506eda546585/egress-router-binary-copy/0.log"
Jul 09 18:16:31.471425 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.471373    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pnrtm_28f05b04-e9c8-40cc-a1a9-506eda546585/cni-plugins/0.log"
Jul 09 18:16:31.490504 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.490485    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pnrtm_28f05b04-e9c8-40cc-a1a9-506eda546585/bond-cni-plugin/0.log"
Jul 09 18:16:31.510790 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.510771    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pnrtm_28f05b04-e9c8-40cc-a1a9-506eda546585/routeoverride-cni/0.log"
Jul 09 18:16:31.530380 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.530363    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pnrtm_28f05b04-e9c8-40cc-a1a9-506eda546585/whereabouts-cni-bincopy/0.log"
Jul 09 18:16:31.552508 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.552490    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pnrtm_28f05b04-e9c8-40cc-a1a9-506eda546585/whereabouts-cni/0.log"
Jul 09 18:16:31.590132 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.590114    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c2tqn_757899f3-7ab9-4214-b494-b457ad9a8986/kube-multus/0.log"
Jul 09 18:16:31.783645 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.783577    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zln6d_75e411b6-ea5d-48ef-b050-3819a0dee45a/network-metrics-daemon/0.log"
Jul 09 18:16:31.803343 ip-10-0-129-85 kubenswrapper[2583]: I0709 18:16:31.803297    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zln6d_75e411b6-ea5d-48ef-b050-3819a0dee45a/kube-rbac-proxy/0.log"