Jul 01 18:06:30.653550 ip-10-0-136-171 systemd[1]: Starting Kubernetes Kubelet...
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.151940    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156889    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156903    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156908    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156913    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156917    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156920    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156923    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:06:31.193581 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156926    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156929    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156931    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156934    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156937    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156940    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156945    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156949    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156952    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156955    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156957    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156960    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156964    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156967    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156970    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156972    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156975    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156978    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156981    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:06:31.194495 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156984    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156986    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156989    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156993    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156996    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.156999    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157002    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157009    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157012    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157014    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157017    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157021    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157024    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157027    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157030    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157033    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157035    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157039    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157042    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:06:31.196103 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157045    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157048    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157050    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157053    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157056    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157059    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157063    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157066    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157069    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157072    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157074    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157077    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157080    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157082    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157085    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157089    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157092    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157095    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157099    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157101    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:06:31.196821 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157104    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157108    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157110    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157113    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157116    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157119    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157121    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157124    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157127    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157129    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157132    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157135    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157139    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157141    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157144    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157146    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157150    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157153    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157158    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157163    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:06:31.197513 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157168    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157172    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157176    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157181    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157186    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157189    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157192    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157195    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157207    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157211    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157213    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157216    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157220    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.157222    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158045    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158052    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158055    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158059    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158061    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158064    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:06:31.199622 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158068    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158071    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158074    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158077    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158080    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158083    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158086    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158089    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158092    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158095    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158097    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158100    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158103    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158106    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158109    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158112    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158115    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158118    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158120    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158126    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:06:31.200297 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158130    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158133    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158138    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158143    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158146    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158149    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158151    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158155    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158158    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158161    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158164    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158166    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158170    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158172    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158175    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158178    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158181    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158183    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158186    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158189    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:06:31.201880 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158192    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158194    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158198    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158201    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158204    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158206    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158209    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158212    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158214    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158217    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158220    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158223    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158226    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158231    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158234    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158237    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158240    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158242    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158245    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:06:31.202553 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158248    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158252    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158254    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158257    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158260    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158262    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158265    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158268    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158270    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158273    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158275    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158278    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158281    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158284    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158286    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158289    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158292    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158294    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158299    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:06:31.204183 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158302    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158306    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158310    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158329    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158332    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158335    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158338    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158342    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158345    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158348    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158355    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158357    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158360    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158363    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158366    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158769    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158774    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158777    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158780    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158783    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:06:31.204893 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158786    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158789    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158792    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158795    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158797    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158801    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158805    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158808    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158810    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158813    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158818    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158822    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158825    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158828    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158831    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158834    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158837    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158840    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158844    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:06:31.205584 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158849    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158852    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158855    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158858    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158861    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158864    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158866    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158869    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158872    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158875    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158878    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158881    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158883    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158886    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158889    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158892    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158895    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158897    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158900    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158904    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:06:31.206266 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158907    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158910    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158912    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158915    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158918    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158921    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158923    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158926    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158929    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158931    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158934    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158937    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158942    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158944    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158947    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158950    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158952    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158955    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158958    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158960    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:06:31.206961 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158964    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158968    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158971    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158973    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158976    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158981    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158984    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158986    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158989    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158992    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158994    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.158997    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159000    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159002    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159005    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159007    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159010    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159012    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159015    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159018    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:06:31.207650 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159020    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159023    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159026    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159028    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159034    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159037    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159039    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159042    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159045    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159048    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159052    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159055    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159059    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159062    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159066    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159136    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159143    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159151    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159157    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159161    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159165    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 01 18:06:31.208582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159169    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159174    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159178    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159181    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159185    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159188    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159191    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159195    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159198    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159202    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159205    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159208    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159213    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159216    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159220    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159224    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159228    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159232    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159235    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159238    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159242    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159245    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159248    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159251    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 01 18:06:31.209240 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159254    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159257    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159262    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159266    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159271    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159274    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159277    2567 flags.go:64] FLAG: --enable-server="true"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159280    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159285    2567 flags.go:64] FLAG: --event-burst="100"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159288    2567 flags.go:64] FLAG: --event-qps="50"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159291    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159294    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159297    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159302    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159305    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159308    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159325    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159328    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159331    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159335    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159338    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159341    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159344    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159349    2567 flags.go:64] FLAG: --feature-gates=""
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159353    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 01 18:06:31.210155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159356    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159360    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159363    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159366    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159369    2567 flags.go:64] FLAG: --help="false"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159372    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159376    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159379    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159382    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159385    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159390    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159394    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159397    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159400    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159404    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159407    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159410    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159413    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159416    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159419    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159422    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159425    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159428    2567 flags.go:64] FLAG: --lock-file=""
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159431    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 01 18:06:31.211065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159434    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159437    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159443    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159446    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159449    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159452    2567 flags.go:64] FLAG: --logging-format="text"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159456    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159460    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159463    2567 flags.go:64] FLAG: --manifest-url=""
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159466    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159471    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159474    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159479    2567 flags.go:64] FLAG: --max-pods="110"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159482    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159485    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159488    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159491    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159495    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159498    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159505    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159513    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159517    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159520    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 01 18:06:31.212003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159523    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159526    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159532    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159535    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159539    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159542    2567 flags.go:64] FLAG: --port="10250"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159545    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159548    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0086e4bc563cb8547"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159551    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159555    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159558    2567 flags.go:64] FLAG: --register-node="true"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159561    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159565    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159568    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159571    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159574    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159579    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159582    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159585    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159588    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159591    2567 flags.go:64] FLAG: --runonce="false"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159594    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159598    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159601    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159604    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 01 18:06:31.212716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159608    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159611    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159614    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159619    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159623    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159626    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159629    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159632    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159635    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159638    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159641    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159647    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159649    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159652    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159657    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159660    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159663    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159666    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159669    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159672    2567 flags.go:64] FLAG: --v="2"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159676    2567 flags.go:64] FLAG: --version="false"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159681    2567 flags.go:64] FLAG: --vmodule=""
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159684    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.159689    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159818    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:06:31.213565 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159822    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159826    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159829    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159832    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159835    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159838    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159841    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159844    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159847    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159850    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159855    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159857    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159861    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159863    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159867    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159869    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159873    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159877    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159880    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:06:31.214338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159883    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159886    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159888    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159891    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159894    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159897    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159900    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159903    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159905    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159908    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159911    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159915    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159920    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159923    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159926    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159930    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159933    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159936    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159939    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:06:31.216231 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159943    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159946    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159949    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159952    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159956    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159959    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159962    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159965    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159967    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159970    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159973    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159976    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159979    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159981    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159984    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159986    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159989    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159992    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.159996    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:06:31.216909 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160000    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160003    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160006    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160009    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160012    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160016    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160019    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160021    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160024    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160027    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160030    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160032    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160035    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160038    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160040    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160043    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160046    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160050    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160053    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160056    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:06:31.296120 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160059    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:06:31.285783 ip-10-0-136-171 systemd[1]: Started Kubernetes Kubelet.
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160062    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160065    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160068    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160071    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160074    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160076    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160079    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160082    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160084    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160087    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160090    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160092    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160095    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160097    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160100    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160103    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160107    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160109    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160112    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:06:31.297130 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.160115    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.160122    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.170574    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.170595    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.170623    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.170638    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170750    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170756    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170760    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170765    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170773    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170777    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170780    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170784    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:06:31.297832 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170787    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170791    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170794    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170798    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170801    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170804    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170808    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170811    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170818    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170820    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170824    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170827    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170830    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170835    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170839    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170843    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170846    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170850    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170853    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170857    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:06:31.298819 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170860    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170867    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170870    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170873    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170876    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170880    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170883    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170886    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170889    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170892    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170895    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170898    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170901    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170907    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170910    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170913    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170916    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170919    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170922    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170924    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:06:31.300042 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170927    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170930    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170933    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170936    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170938    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170942    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170947    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170954    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170957    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170960    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170964    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170973    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170976    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170979    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170983    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170986    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170989    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170992    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.170997    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:06:31.301810 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171000    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171003    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171006    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171009    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171012    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171015    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171018    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171021    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171024    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171027    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171030    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171033    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171038    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171041    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171044    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171047    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171050    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171053    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171056    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:06:31.302502 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171059    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171064    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171067    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171070    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171073    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171078    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171081    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171084    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171087    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171090    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171093    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171096    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171099    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.171105    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171375    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 18:06:31.303195 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171382    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171386    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171389    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171391    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171394    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171397    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171400    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171406    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171409    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171412    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171415    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171418    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171421    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171424    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171428    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171431    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171434    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171437    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171440    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171446    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 18:06:31.303867 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171452    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171455    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171458    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171461    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171465    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171467    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171470    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171474    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171477    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171479    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171482    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171485    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171488    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171494    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171497    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171500    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171503    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171507    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171509    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171512    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 18:06:31.305031 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171515    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171518    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171521    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171524    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171527    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171532    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171536    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171539    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171542    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171545    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171548    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171552    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171555    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171558    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171561    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171564    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171568    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171576    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171579    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 18:06:31.305709 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171582    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171586    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171589    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171593    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171597    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171600    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171603    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171607    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171610    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171614    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171620    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171623    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171626    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171629    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171631    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171634    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171638    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171641    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171643    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 18:06:31.307088 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171648    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171651    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171654    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171657    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171663    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171668    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171670    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171673    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171676    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171679    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171682    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171685    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171688    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171691    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171694    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171700    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171706    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171709    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171712    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 18:06:31.307790 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:31.171715    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.171721    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.171908    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.176836    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.178425    2567 server.go:1019] "Starting client certificate rotation"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.180826    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.180865    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.186283    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.226415    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.238140    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.240463    2567 log.go:25] "Validated CRI v1 image API"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.242062    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 01 18:06:31.309197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.244854    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 802edd5d-3f64-481f-ad74-998662927ac0:/dev/nvme0n1p3 bde75272-d570-4883-9b8f-4b63d2f92ce3:/dev/nvme0n1p4]
Jul 01 18:06:31.309684 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.244873    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 01 18:06:31.310608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.252573    2567 manager.go:216] Machine: {Timestamp:2026-07-01 18:06:31.252021477 +0000 UTC m=+0.482094304 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099838 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2a36f45b9d851c4c11eaf8b1337f SystemUUID:ec2f2a36-f45b-9d85-1c4c-11eaf8b1337f BootID:9a889410-041d-45fa-9364-7f0a187bd5e6 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:1a:b6:8c:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:1a:b6:8c:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:d2:33:ea:00:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 01 18:06:31.310608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.252695    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 01 18:06:31.310608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.252826    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 01 18:06:31.310608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.255438    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 01 18:06:31.310608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.255476    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-171.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 01 18:06:31.310608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.256253    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 01 18:06:31.310608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.256266    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 01 18:06:31.310608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.256274    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.257254    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.258211    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.259012    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.261883    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.262024    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.262061    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.262075    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.262091    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.262102    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.262112    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.262636    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.262658    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.273292    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.276607    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.276771    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.278850    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.278883    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279061    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279074    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279081    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279087    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279096    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279102    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279711    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279718    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279726    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279732    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279741    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.279749    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.280901    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.280908    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.284706    2567 server.go:1268] "Started kubelet"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.284806    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.284907    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.285043    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.286354    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.287490    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.293905    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.298728    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.299292    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 01 18:06:31.311112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.299308    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 01 18:06:31.312941 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.299503    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:31.312941 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.299657    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 01 18:06:31.312941 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.299744    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 01 18:06:31.312941 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.299753    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.322498    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xrp82"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.322527    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xrp82"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.323128    2567 factory.go:55] Registering systemd factory
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.323149    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.323384    2567 factory.go:153] Registering CRI-O factory
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.323397    2567 factory.go:223] Registration of the crio container factory successfully
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.323456    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.323480    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.323489    2567 factory.go:103] Registering Raw factory
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.323526    2567 manager.go:1196] Started watching for new ooms in manager
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.323953    2567 manager.go:349] Starting recovery of all containers
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.329621    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.329701    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.329875    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-171.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.329938    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-171.ec2.internal.18be3ca732326612  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-171.ec2.internal,UID:ip-10-0-136-171.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-171.ec2.internal,},FirstTimestamp:2026-07-01 18:06:31.284663826 +0000 UTC m=+0.514736656,LastTimestamp:2026-07-01 18:06:31.284663826 +0000 UTC m=+0.514736656,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-171.ec2.internal,}"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.335616    2567 manager.go:354] Recovery completed
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.348631    2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.353048    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.360177    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.360210    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.360221    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.360830    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.360842    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.360848    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.360861    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.361661    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.361694    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.361713    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:06:31.445303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.362463    2567 policy_none.go:49] "None policy: Start"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.362476    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.362486    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.363879    2567 policy_none.go:47] "Start"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.401145    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.419078    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.420541    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.420592    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.420625    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.420669    2567 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.421636    2567 manager.go:337] "Starting Device Plugin manager"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.421677    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.421691    2567 server.go:87] "Starting device plugin registration server"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.422078    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.422095    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.422206    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.422351    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.422361    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.422871    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.422924    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:31.466496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.423151    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.521893    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal"]
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.522014    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.522177    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.523052    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.523081    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.523093    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.523116    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.523864    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.523889    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.523902    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.525505    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.525674    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.525710    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.526336    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.526361    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.526376    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.526422    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.526445    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.526455    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.527655    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.527678    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.528440    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.528469    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.528479    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeHasSufficientPID"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.531835    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.531859    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-171.ec2.internal\": node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.552095    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-171.ec2.internal\" not found" node="ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.555738    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-171.ec2.internal\" not found" node="ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.635704 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.562182    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.662466    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.704501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5fdc564b01e47bd6f5426b018ec2e9c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal\" (UID: \"5fdc564b01e47bd6f5426b018ec2e9c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.704551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fdc564b01e47bd6f5426b018ec2e9c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal\" (UID: \"5fdc564b01e47bd6f5426b018ec2e9c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.704576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0d496fb63956da7a6ed47cfee6c9f2e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-171.ec2.internal\" (UID: \"b0d496fb63956da7a6ed47cfee6c9f2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.764631    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.804982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5fdc564b01e47bd6f5426b018ec2e9c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal\" (UID: \"5fdc564b01e47bd6f5426b018ec2e9c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.805012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fdc564b01e47bd6f5426b018ec2e9c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal\" (UID: \"5fdc564b01e47bd6f5426b018ec2e9c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.805033    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0d496fb63956da7a6ed47cfee6c9f2e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-171.ec2.internal\" (UID: \"b0d496fb63956da7a6ed47cfee6c9f2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.805082    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5fdc564b01e47bd6f5426b018ec2e9c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal\" (UID: \"5fdc564b01e47bd6f5426b018ec2e9c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.805103    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fdc564b01e47bd6f5426b018ec2e9c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal\" (UID: \"5fdc564b01e47bd6f5426b018ec2e9c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.811721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.805094    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0d496fb63956da7a6ed47cfee6c9f2e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-171.ec2.internal\" (UID: \"b0d496fb63956da7a6ed47cfee6c9f2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.983154 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.859207    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.983154 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:31.859207    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:31.983154 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.865483    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:31.983154 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:31.965595    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:32.129984 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:32.069670    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:32.242241 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:32.169833    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:32.242241 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.178113    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 01 18:06:32.242241 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.178308    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 18:06:32.382942 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:32.270790    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:32.382942 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.332426    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 18:01:31 +0000 UTC" deadline="2027-12-23 01:47:26.663631351 +0000 UTC"
Jul 01 18:06:32.382942 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.332465    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12943h40m54.331169923s"
Jul 01 18:06:32.382942 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.362970    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:06:32.382942 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:32.371234    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:32.471593 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:32.471559    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:32.515954 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.515872    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:06:32.556941 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:32.556907    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdc564b01e47bd6f5426b018ec2e9c6.slice/crio-9a1d50421d857ff0ee13d3b7a1ccd38af08361e26c03bc52b8a353ef4849d9e8 WatchSource:0}: Error finding container 9a1d50421d857ff0ee13d3b7a1ccd38af08361e26c03bc52b8a353ef4849d9e8: Status 404 returned error can't find the container with id 9a1d50421d857ff0ee13d3b7a1ccd38af08361e26c03bc52b8a353ef4849d9e8
Jul 01 18:06:32.557327 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:32.557307    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d496fb63956da7a6ed47cfee6c9f2e.slice/crio-8d983e2ea72ff289f94812eb47ffcc45ff2b4f5b6217d982301c5704d1f1908e WatchSource:0}: Error finding container 8d983e2ea72ff289f94812eb47ffcc45ff2b4f5b6217d982301c5704d1f1908e: Status 404 returned error can't find the container with id 8d983e2ea72ff289f94812eb47ffcc45ff2b4f5b6217d982301c5704d1f1908e
Jul 01 18:06:32.564159 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.564136    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 18:06:32.572679 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:32.572661    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:32.673435 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:32.673400    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-171.ec2.internal\" not found"
Jul 01 18:06:32.703332 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.703308    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:06:32.800640 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.800534    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:32.812679 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.812651    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 18:06:32.813814 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.813796    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal"
Jul 01 18:06:32.822656 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:32.822628    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 18:06:33.267107 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.267026    2567 apiserver.go:52] "Watching apiserver"
Jul 01 18:06:33.274092 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.274061    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 01 18:06:33.275901 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.275871    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s","openshift-cluster-node-tuning-operator/tuned-4xrhm","openshift-dns/node-resolver-gq6w6","openshift-network-diagnostics/network-check-target-h84lh","openshift-ovn-kubernetes/ovnkube-node-kc7vf","kube-system/global-pull-secret-syncer-4hhs2","openshift-image-registry/node-ca-28ftw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal","openshift-multus/multus-additional-cni-plugins-xhs4g","openshift-multus/multus-z5vlp","openshift-multus/network-metrics-daemon-ccl99","openshift-network-operator/iptables-alerter-cpbss","kube-system/konnectivity-agent-stdmb"]
Jul 01 18:06:33.278380 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.278340    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.278508 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.278431    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:33.279943 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.279891    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.281748 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.281723    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.282787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.282749    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 01 18:06:33.282787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.282776    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tts7v\""
Jul 01 18:06:33.282950 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.282779    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 01 18:06:33.282950 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.282853    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 01 18:06:33.283511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.283367    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.284021 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.284002    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s5d6x\""
Jul 01 18:06:33.284170 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.284148    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 01 18:06:33.284343 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.284323    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 01 18:06:33.285190 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.285173    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:33.285287 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.285230    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:33.286150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.286133    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 01 18:06:33.286283 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.286261    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 01 18:06:33.286432 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.286418    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-49hlv\""
Jul 01 18:06:33.287251 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.287180    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.288805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.288785    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:33.291249 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.290878    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.291249 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.290904    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 01 18:06:33.291249 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.290976    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 01 18:06:33.291454 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.291293    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ntvm8\""
Jul 01 18:06:33.291511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.291467    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 01 18:06:33.292020 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.291994    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 01 18:06:33.292120 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.292073    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 01 18:06:33.292208 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.292185    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 01 18:06:33.293045 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.293023    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hkm2d\""
Jul 01 18:06:33.293150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.293131    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 01 18:06:33.293302 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.293285    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 01 18:06:33.293302 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.293296    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 01 18:06:33.294467 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.294435    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.294633 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.294606    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bqn9z\""
Jul 01 18:06:33.295438 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.295413    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 01 18:06:33.295541 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.295437    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 01 18:06:33.297395 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.297375    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vr9kh\""
Jul 01 18:06:33.297502 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.297395    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 01 18:06:33.297502 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.297398    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 01 18:06:33.297680 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.297500    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 01 18:06:33.298003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.297977    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.299564 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.299545    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.300705 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.300477    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 01 18:06:33.300705 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.300560    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 01 18:06:33.300705 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.300694    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 01 18:06:33.300949 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.300812    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 01 18:06:33.300949 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.300862    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 01 18:06:33.301182 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.301037    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 01 18:06:33.301182 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.301092    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pnvfz\""
Jul 01 18:06:33.301824 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.301801    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 01 18:06:33.301926 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.301876    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4tfcw\""
Jul 01 18:06:33.301988 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.301951    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:33.302041 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.302011    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:33.315068 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-env-overrides\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.315167 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315079    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-daemon-config\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.315167 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315104    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:33.315167 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315125    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wxf\" (UniqueName: \"kubernetes.io/projected/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-kube-api-access-k4wxf\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:33.315167 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315142    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-run\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.315167 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315157    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-cni-dir\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.315482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315178    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-lib-modules\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.315482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-run-ovn\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.315482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315370    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-ovn-node-metrics-cert\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.315482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315396    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc7zw\" (UniqueName: \"kubernetes.io/projected/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-kube-api-access-vc7zw\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.315482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315422    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3da39a8b-9978-4ebf-9f87-f2387c65185e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.315482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315446    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-sys\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-sysconfig\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315511    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a790c2fc-ab73-4563-ba30-750c24832b46-iptables-alerter-script\") pod \"iptables-alerter-cpbss\" (UID: \"a790c2fc-ab73-4563-ba30-750c24832b46\") " pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315536    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a790c2fc-ab73-4563-ba30-750c24832b46-host-slash\") pod \"iptables-alerter-cpbss\" (UID: \"a790c2fc-ab73-4563-ba30-750c24832b46\") " pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315559    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-kubelet\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315585    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-slash\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3da39a8b-9978-4ebf-9f87-f2387c65185e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315634    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-run-systemd\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-sysctl-conf\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38b432e2-719c-43e1-b685-fa97ebd5ad32-tmp\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315720    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-systemd-units\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315745    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315749    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 18:06:33.315784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315770    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-sys-fs\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315794    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8bkt\" (UniqueName: \"kubernetes.io/projected/0612bebc-667e-4ebe-a969-a6a607e61612-kube-api-access-z8bkt\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-run-k8s-cni-cncf-io\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-cni-netd\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvd6b\" (UniqueName: \"kubernetes.io/projected/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-kube-api-access-vvd6b\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315896    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d599f9-956d-4ac5-81c3-c1b9351e30a8-tmp-dir\") pod \"node-resolver-gq6w6\" (UID: \"c1d599f9-956d-4ac5-81c3-c1b9351e30a8\") " pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315927    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-systemd\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315974    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-dbus\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.315998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316036    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-ovnkube-config\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3da39a8b-9978-4ebf-9f87-f2387c65185e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316088    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-socket-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316112    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-os-release\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316136    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-node-log\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.316542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-log-socket\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316197    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-cni-bin\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31142a55-0cf1-4ec1-aecb-625cf095258f-agent-certs\") pod \"konnectivity-agent-stdmb\" (UID: \"31142a55-0cf1-4ec1-aecb-625cf095258f\") " pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31142a55-0cf1-4ec1-aecb-625cf095258f-konnectivity-ca\") pod \"konnectivity-agent-stdmb\" (UID: \"31142a55-0cf1-4ec1-aecb-625cf095258f\") " pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-var-lib-kubelet\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316359    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-sysctl-d\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316401    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-var-lib-kubelet\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd95642d-fd67-4914-8f8e-2a1b1efd9e99-serviceca\") pod \"node-ca-28ftw\" (UID: \"cd95642d-fd67-4914-8f8e-2a1b1efd9e99\") " pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316482    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-run-netns\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-var-lib-cni-multus\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316534    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-conf-dir\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-host\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwdfq\" (UniqueName: \"kubernetes.io/projected/cd95642d-fd67-4914-8f8e-2a1b1efd9e99-kube-api-access-qwdfq\") pod \"node-ca-28ftw\" (UID: \"cd95642d-fd67-4914-8f8e-2a1b1efd9e99\") " pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.317234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316622    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-hostroot\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316647    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-kubernetes\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316717    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-var-lib-openvswitch\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316761    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-run-openvswitch\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-ovnkube-script-lib\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316857    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-device-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-run-multus-certs\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316938    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-etc-kubernetes\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.316969    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-run-netns\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317040    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd95642d-fd67-4914-8f8e-2a1b1efd9e99-host\") pod \"node-ca-28ftw\" (UID: \"cd95642d-fd67-4914-8f8e-2a1b1efd9e99\") " pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-cnibin\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317102    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-kubelet-config\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwknv\" (UniqueName: \"kubernetes.io/projected/38b432e2-719c-43e1-b685-fa97ebd5ad32-kube-api-access-jwknv\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.317940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317195    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1d599f9-956d-4ac5-81c3-c1b9351e30a8-hosts-file\") pod \"node-resolver-gq6w6\" (UID: \"c1d599f9-956d-4ac5-81c3-c1b9351e30a8\") " pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317242    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-registration-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317271    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-system-cni-dir\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-var-lib-cni-bin\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317361    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-modprobe-d\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-tuned\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s9lm\" (UniqueName: \"kubernetes.io/projected/3da39a8b-9978-4ebf-9f87-f2387c65185e-kube-api-access-6s9lm\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpn2v\" (UniqueName: \"kubernetes.io/projected/a790c2fc-ab73-4563-ba30-750c24832b46-kube-api-access-rpn2v\") pod \"iptables-alerter-cpbss\" (UID: \"a790c2fc-ab73-4563-ba30-750c24832b46\") " pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-cni-binary-copy\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317522    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9zq9\" (UniqueName: \"kubernetes.io/projected/c1d599f9-956d-4ac5-81c3-c1b9351e30a8-kube-api-access-l9zq9\") pod \"node-resolver-gq6w6\" (UID: \"c1d599f9-956d-4ac5-81c3-c1b9351e30a8\") " pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-etc-openvswitch\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.318676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317611    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-system-cni-dir\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.319355 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317634    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-cnibin\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.319355 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-os-release\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.319355 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.319355 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.317740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-socket-dir-parent\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.339904 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.339856    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xqql8"
Jul 01 18:06:33.345461 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.345436    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xqql8"
Jul 01 18:06:33.400829 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.400802    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 01 18:06:33.418184 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-modprobe-d\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.418346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-tuned\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.418346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s9lm\" (UniqueName: \"kubernetes.io/projected/3da39a8b-9978-4ebf-9f87-f2387c65185e-kube-api-access-6s9lm\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.418346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpn2v\" (UniqueName: \"kubernetes.io/projected/a790c2fc-ab73-4563-ba30-750c24832b46-kube-api-access-rpn2v\") pod \"iptables-alerter-cpbss\" (UID: \"a790c2fc-ab73-4563-ba30-750c24832b46\") " pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.418346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418292    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-cni-binary-copy\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.418346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418318    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9zq9\" (UniqueName: \"kubernetes.io/projected/c1d599f9-956d-4ac5-81c3-c1b9351e30a8-kube-api-access-l9zq9\") pod \"node-resolver-gq6w6\" (UID: \"c1d599f9-956d-4ac5-81c3-c1b9351e30a8\") " pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.418346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418348    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-modprobe-d\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-etc-openvswitch\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418409    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-system-cni-dir\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-cnibin\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418462    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-os-release\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418518    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-socket-dir-parent\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-env-overrides\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418568    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-daemon-config\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wxf\" (UniqueName: \"kubernetes.io/projected/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-kube-api-access-k4wxf\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-run\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418647    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 01 18:06:33.418688 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-cni-dir\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-lib-modules\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-run-ovn\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418762    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-ovn-node-metrics-cert\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418775    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418788    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7zw\" (UniqueName: \"kubernetes.io/projected/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-kube-api-access-vc7zw\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418817    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3da39a8b-9978-4ebf-9f87-f2387c65185e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-sys\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418950    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-sysconfig\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.418975    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a790c2fc-ab73-4563-ba30-750c24832b46-iptables-alerter-script\") pod \"iptables-alerter-cpbss\" (UID: \"a790c2fc-ab73-4563-ba30-750c24832b46\") " pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419008    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a790c2fc-ab73-4563-ba30-750c24832b46-host-slash\") pod \"iptables-alerter-cpbss\" (UID: \"a790c2fc-ab73-4563-ba30-750c24832b46\") " pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419033    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-kubelet\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419035    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-cni-binary-copy\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-slash\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.419422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419113    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3da39a8b-9978-4ebf-9f87-f2387c65185e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419116    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-slash\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419109    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-socket-dir-parent\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419226    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-etc-openvswitch\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419293    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-system-cni-dir\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419366    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-cnibin\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419438    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-os-release\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419495    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-sysconfig\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419662    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-daemon-config\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419780    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3da39a8b-9978-4ebf-9f87-f2387c65185e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.419812    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.419853    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a790c2fc-ab73-4563-ba30-750c24832b46-host-slash\") pod \"iptables-alerter-cpbss\" (UID: \"a790c2fc-ab73-4563-ba30-750c24832b46\") " pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.420138 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.419891    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs podName:bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb nodeName:}" failed. No retries permitted until 2026-07-01 18:06:33.919869642 +0000 UTC m=+3.149942474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs") pod "network-metrics-daemon-ccl99" (UID: "bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420158    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-run\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420177    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3da39a8b-9978-4ebf-9f87-f2387c65185e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420224    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-cni-dir\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420254    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-sys\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420332    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-kubelet\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420376    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a790c2fc-ab73-4563-ba30-750c24832b46-iptables-alerter-script\") pod \"iptables-alerter-cpbss\" (UID: \"a790c2fc-ab73-4563-ba30-750c24832b46\") " pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420426    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-lib-modules\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420517    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-run-ovn\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420566    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-run-systemd\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420594    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-sysctl-conf\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38b432e2-719c-43e1-b685-fa97ebd5ad32-tmp\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-systemd-units\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-sys-fs\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.420818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420753    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8bkt\" (UniqueName: \"kubernetes.io/projected/0612bebc-667e-4ebe-a969-a6a607e61612-kube-api-access-z8bkt\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420756    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-sysctl-conf\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420638    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-run-systemd\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420870    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-etc-selinux\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420910    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-env-overrides\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420914    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-run-k8s-cni-cncf-io\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420954    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-sys-fs\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420993    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-systemd-units\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.420777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-run-k8s-cni-cncf-io\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-cni-netd\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvd6b\" (UniqueName: \"kubernetes.io/projected/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-kube-api-access-vvd6b\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d599f9-956d-4ac5-81c3-c1b9351e30a8-tmp-dir\") pod \"node-resolver-gq6w6\" (UID: \"c1d599f9-956d-4ac5-81c3-c1b9351e30a8\") " pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-systemd\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421112    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-cni-netd\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421147    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-dbus\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.421601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421211    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-ovnkube-config\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421238    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3da39a8b-9978-4ebf-9f87-f2387c65185e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421267    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-socket-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-os-release\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-node-log\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-log-socket\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.421391    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-cni-bin\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.421441    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret podName:75251e3f-b5d0-4ba0-8ccf-9af0898a0b09 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:33.921425551 +0000 UTC m=+3.151498368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret") pod "global-pull-secret-syncer-4hhs2" (UID: "75251e3f-b5d0-4ba0-8ccf-9af0898a0b09") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421439    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d599f9-956d-4ac5-81c3-c1b9351e30a8-tmp-dir\") pod \"node-resolver-gq6w6\" (UID: \"c1d599f9-956d-4ac5-81c3-c1b9351e30a8\") " pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421476    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421477    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31142a55-0cf1-4ec1-aecb-625cf095258f-agent-certs\") pod \"konnectivity-agent-stdmb\" (UID: \"31142a55-0cf1-4ec1-aecb-625cf095258f\") " pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:33.422443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31142a55-0cf1-4ec1-aecb-625cf095258f-konnectivity-ca\") pod \"konnectivity-agent-stdmb\" (UID: \"31142a55-0cf1-4ec1-aecb-625cf095258f\") " pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421540    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-systemd\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-var-lib-kubelet\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-sysctl-d\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421595    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-node-log\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-var-lib-kubelet\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421637    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-log-socket\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421640    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd95642d-fd67-4914-8f8e-2a1b1efd9e99-serviceca\") pod \"node-ca-28ftw\" (UID: \"cd95642d-fd67-4914-8f8e-2a1b1efd9e99\") " pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-run-netns\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421674    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-cni-bin\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-var-lib-cni-multus\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-conf-dir\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-host\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwdfq\" (UniqueName: \"kubernetes.io/projected/cd95642d-fd67-4914-8f8e-2a1b1efd9e99-kube-api-access-qwdfq\") pod \"node-ca-28ftw\" (UID: \"cd95642d-fd67-4914-8f8e-2a1b1efd9e99\") " pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421803    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-hostroot\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.423148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421827    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-kubernetes\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-var-lib-openvswitch\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-run-openvswitch\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421932    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-ovnkube-script-lib\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-device-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.421988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-run-multus-certs\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422013    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-etc-kubernetes\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-run-netns\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422068    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422097    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd95642d-fd67-4914-8f8e-2a1b1efd9e99-host\") pod \"node-ca-28ftw\" (UID: \"cd95642d-fd67-4914-8f8e-2a1b1efd9e99\") " pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-cnibin\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-kubelet-config\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422184    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31142a55-0cf1-4ec1-aecb-625cf095258f-konnectivity-ca\") pod \"konnectivity-agent-stdmb\" (UID: \"31142a55-0cf1-4ec1-aecb-625cf095258f\") " pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422190    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwknv\" (UniqueName: \"kubernetes.io/projected/38b432e2-719c-43e1-b685-fa97ebd5ad32-kube-api-access-jwknv\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422242    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd95642d-fd67-4914-8f8e-2a1b1efd9e99-serviceca\") pod \"node-ca-28ftw\" (UID: \"cd95642d-fd67-4914-8f8e-2a1b1efd9e99\") " pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.423925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422274    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422333    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1d599f9-956d-4ac5-81c3-c1b9351e30a8-hosts-file\") pod \"node-resolver-gq6w6\" (UID: \"c1d599f9-956d-4ac5-81c3-c1b9351e30a8\") " pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422360    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-var-lib-kubelet\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422391    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422418    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-os-release\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422456    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-run-netns\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422520    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-sysctl-d\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422529    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-var-lib-cni-multus\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422568    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-var-lib-kubelet\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422609    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-hostroot\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422613    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-multus-conf-dir\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422647    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-host\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422708    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-kubernetes\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422755    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-var-lib-openvswitch\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422799    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-run-openvswitch\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.424706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422839    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-host-run-netns\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422883    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-device-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422914    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-run-multus-certs\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422918    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-ovnkube-config\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422940    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-etc-kubernetes\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422959    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-socket-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-registration-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.422995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-system-cni-dir\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-var-lib-cni-bin\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423117    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-host-var-lib-cni-bin\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423170    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c1d599f9-956d-4ac5-81c3-c1b9351e30a8-hosts-file\") pod \"node-resolver-gq6w6\" (UID: \"c1d599f9-956d-4ac5-81c3-c1b9351e30a8\") " pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423219    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0612bebc-667e-4ebe-a969-a6a607e61612-registration-dir\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423261    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-system-cni-dir\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423303    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd95642d-fd67-4914-8f8e-2a1b1efd9e99-host\") pod \"node-ca-28ftw\" (UID: \"cd95642d-fd67-4914-8f8e-2a1b1efd9e99\") " pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423310    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-ovnkube-script-lib\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.425473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423396    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-cnibin\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.426200 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423442    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-kubelet-config\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.426200 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423455    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3da39a8b-9978-4ebf-9f87-f2387c65185e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.426200 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423458    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3da39a8b-9978-4ebf-9f87-f2387c65185e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.426200 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423690    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-dbus\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.426200 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.423776    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-ovn-node-metrics-cert\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.426200 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.426197    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:06:33.426526 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.426217    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:06:33.426526 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.426233    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sggdm for pod openshift-network-diagnostics/network-check-target-h84lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:33.426526 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.426297    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm podName:ab32ca0a-ddca-440f-8ec3-1344e2586896 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:33.926282103 +0000 UTC m=+3.156354938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sggdm" (UniqueName: "kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm") pod "network-check-target-h84lh" (UID: "ab32ca0a-ddca-440f-8ec3-1344e2586896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:33.426999 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.426974    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31142a55-0cf1-4ec1-aecb-625cf095258f-agent-certs\") pod \"konnectivity-agent-stdmb\" (UID: \"31142a55-0cf1-4ec1-aecb-625cf095258f\") " pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:33.427627 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.427541    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal" event={"ID":"5fdc564b01e47bd6f5426b018ec2e9c6","Type":"ContainerStarted","Data":"9a1d50421d857ff0ee13d3b7a1ccd38af08361e26c03bc52b8a353ef4849d9e8"}
Jul 01 18:06:33.428930 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.428904    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38b432e2-719c-43e1-b685-fa97ebd5ad32-tmp\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.429363 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.429296    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38b432e2-719c-43e1-b685-fa97ebd5ad32-etc-tuned\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.430037 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.430008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal" event={"ID":"b0d496fb63956da7a6ed47cfee6c9f2e","Type":"ContainerStarted","Data":"8d983e2ea72ff289f94812eb47ffcc45ff2b4f5b6217d982301c5704d1f1908e"}
Jul 01 18:06:33.431208 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.431153    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9zq9\" (UniqueName: \"kubernetes.io/projected/c1d599f9-956d-4ac5-81c3-c1b9351e30a8-kube-api-access-l9zq9\") pod \"node-resolver-gq6w6\" (UID: \"c1d599f9-956d-4ac5-81c3-c1b9351e30a8\") " pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.433168 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.433031    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpn2v\" (UniqueName: \"kubernetes.io/projected/a790c2fc-ab73-4563-ba30-750c24832b46-kube-api-access-rpn2v\") pod \"iptables-alerter-cpbss\" (UID: \"a790c2fc-ab73-4563-ba30-750c24832b46\") " pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.435652 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.435605    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8bkt\" (UniqueName: \"kubernetes.io/projected/0612bebc-667e-4ebe-a969-a6a607e61612-kube-api-access-z8bkt\") pod \"aws-ebs-csi-driver-node-ftb7s\" (UID: \"0612bebc-667e-4ebe-a969-a6a607e61612\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.437316 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.436744    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s9lm\" (UniqueName: \"kubernetes.io/projected/3da39a8b-9978-4ebf-9f87-f2387c65185e-kube-api-access-6s9lm\") pod \"multus-additional-cni-plugins-xhs4g\" (UID: \"3da39a8b-9978-4ebf-9f87-f2387c65185e\") " pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.437316 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.436772    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc7zw\" (UniqueName: \"kubernetes.io/projected/6b052a40-d97e-4085-a2b3-8ab15e1e87f0-kube-api-access-vc7zw\") pod \"ovnkube-node-kc7vf\" (UID: \"6b052a40-d97e-4085-a2b3-8ab15e1e87f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.437316 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.437224    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wxf\" (UniqueName: \"kubernetes.io/projected/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-kube-api-access-k4wxf\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:33.437514 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.437380    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwdfq\" (UniqueName: \"kubernetes.io/projected/cd95642d-fd67-4914-8f8e-2a1b1efd9e99-kube-api-access-qwdfq\") pod \"node-ca-28ftw\" (UID: \"cd95642d-fd67-4914-8f8e-2a1b1efd9e99\") " pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.437514 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.437423    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvd6b\" (UniqueName: \"kubernetes.io/projected/eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b-kube-api-access-vvd6b\") pod \"multus-z5vlp\" (UID: \"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b\") " pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.438455 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.438412    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwknv\" (UniqueName: \"kubernetes.io/projected/38b432e2-719c-43e1-b685-fa97ebd5ad32-kube-api-access-jwknv\") pod \"tuned-4xrhm\" (UID: \"38b432e2-719c-43e1-b685-fa97ebd5ad32\") " pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.595210 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.595127    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cpbss"
Jul 01 18:06:33.604696 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.604670    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4xrhm"
Jul 01 18:06:33.613671 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.613645    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gq6w6"
Jul 01 18:06:33.619997 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.619970    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:33.628067 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.628047    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:33.633219 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.633199    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 18:06:33.636470 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.636448    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-28ftw"
Jul 01 18:06:33.644629 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.644603    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s"
Jul 01 18:06:33.654478 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.654461    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xhs4g"
Jul 01 18:06:33.659363 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.659346    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5vlp"
Jul 01 18:06:33.847535 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:33.847499    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0612bebc_667e_4ebe_a969_a6a607e61612.slice/crio-3d8132162f61c8c4c9c80ee98e4d7675272b8396adb13c4904b51195d91bcdd1 WatchSource:0}: Error finding container 3d8132162f61c8c4c9c80ee98e4d7675272b8396adb13c4904b51195d91bcdd1: Status 404 returned error can't find the container with id 3d8132162f61c8c4c9c80ee98e4d7675272b8396adb13c4904b51195d91bcdd1
Jul 01 18:06:33.861492 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:33.861454    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31142a55_0cf1_4ec1_aecb_625cf095258f.slice/crio-2a61a69b5f33df485e1a2444366c7156deca4fc49e75d63bc36b32661021d327 WatchSource:0}: Error finding container 2a61a69b5f33df485e1a2444366c7156deca4fc49e75d63bc36b32661021d327: Status 404 returned error can't find the container with id 2a61a69b5f33df485e1a2444366c7156deca4fc49e75d63bc36b32661021d327
Jul 01 18:06:33.866844 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:33.866806    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b052a40_d97e_4085_a2b3_8ab15e1e87f0.slice/crio-12b859292da47d32dc079d03bf710e5a26de8cebb0d147fdef272c13bd3e7df5 WatchSource:0}: Error finding container 12b859292da47d32dc079d03bf710e5a26de8cebb0d147fdef272c13bd3e7df5: Status 404 returned error can't find the container with id 12b859292da47d32dc079d03bf710e5a26de8cebb0d147fdef272c13bd3e7df5
Jul 01 18:06:33.867618 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:33.867587    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b432e2_719c_43e1_b685_fa97ebd5ad32.slice/crio-a845bcd906e257ab5b470db253aa9a1719c83581bce4a24f71f06f58d60c7576 WatchSource:0}: Error finding container a845bcd906e257ab5b470db253aa9a1719c83581bce4a24f71f06f58d60c7576: Status 404 returned error can't find the container with id a845bcd906e257ab5b470db253aa9a1719c83581bce4a24f71f06f58d60c7576
Jul 01 18:06:33.869081 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:33.868954    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da39a8b_9978_4ebf_9f87_f2387c65185e.slice/crio-6ec58ca6ec7b03bb42df0bdf670d8a0b493fc787da7df4096fc87ed70fd4cedd WatchSource:0}: Error finding container 6ec58ca6ec7b03bb42df0bdf670d8a0b493fc787da7df4096fc87ed70fd4cedd: Status 404 returned error can't find the container with id 6ec58ca6ec7b03bb42df0bdf670d8a0b493fc787da7df4096fc87ed70fd4cedd
Jul 01 18:06:33.869907 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:33.869870    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda790c2fc_ab73_4563_ba30_750c24832b46.slice/crio-aad23e1e825690b22ee2c409bc4f14510bb1dfbc6fecb37c580bd7fe6f1336ba WatchSource:0}: Error finding container aad23e1e825690b22ee2c409bc4f14510bb1dfbc6fecb37c580bd7fe6f1336ba: Status 404 returned error can't find the container with id aad23e1e825690b22ee2c409bc4f14510bb1dfbc6fecb37c580bd7fe6f1336ba
Jul 01 18:06:33.871456 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:33.871430    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d599f9_956d_4ac5_81c3_c1b9351e30a8.slice/crio-09dce7244f4bb32c66479b530d2229d2bb9a9723924de0a01cf08410989b5cba WatchSource:0}: Error finding container 09dce7244f4bb32c66479b530d2229d2bb9a9723924de0a01cf08410989b5cba: Status 404 returned error can't find the container with id 09dce7244f4bb32c66479b530d2229d2bb9a9723924de0a01cf08410989b5cba
Jul 01 18:06:33.872030 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:33.871965    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd95642d_fd67_4914_8f8e_2a1b1efd9e99.slice/crio-49e42d90af50389dc206a9194326a82c741034d68d4c5a02b33193acaa99f06e WatchSource:0}: Error finding container 49e42d90af50389dc206a9194326a82c741034d68d4c5a02b33193acaa99f06e: Status 404 returned error can't find the container with id 49e42d90af50389dc206a9194326a82c741034d68d4c5a02b33193acaa99f06e
Jul 01 18:06:33.873229 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:06:33.872902    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb5cdfe3_5fa7_4404_8cc3_fb0b7ae5944b.slice/crio-06382f09c6d5c7d8f33ac92a89d79cec423365a679d3e074ed3f19780f23aedd WatchSource:0}: Error finding container 06382f09c6d5c7d8f33ac92a89d79cec423365a679d3e074ed3f19780f23aedd: Status 404 returned error can't find the container with id 06382f09c6d5c7d8f33ac92a89d79cec423365a679d3e074ed3f19780f23aedd
Jul 01 18:06:33.926903 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.926871    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:33.926903 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.926910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:33.927175 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:33.926937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:33.927175 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.927056    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:33.927175 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.927104    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:33.927175 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.927134    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs podName:bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb nodeName:}" failed. No retries permitted until 2026-07-01 18:06:34.927112389 +0000 UTC m=+4.157185211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs") pod "network-metrics-daemon-ccl99" (UID: "bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:33.927175 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.927059    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:06:33.927175 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.927160    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret podName:75251e3f-b5d0-4ba0-8ccf-9af0898a0b09 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:34.927143165 +0000 UTC m=+4.157215995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret") pod "global-pull-secret-syncer-4hhs2" (UID: "75251e3f-b5d0-4ba0-8ccf-9af0898a0b09") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:33.927175 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.927165    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:06:33.927175 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.927179    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sggdm for pod openshift-network-diagnostics/network-check-target-h84lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:33.927517 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:33.927218    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm podName:ab32ca0a-ddca-440f-8ec3-1344e2586896 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:34.927204832 +0000 UTC m=+4.157277646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sggdm" (UniqueName: "kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm") pod "network-check-target-h84lh" (UID: "ab32ca0a-ddca-440f-8ec3-1344e2586896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:34.349560 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.349483    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:01:33 +0000 UTC" deadline="2028-01-09 04:52:54.321979375 +0000 UTC"
Jul 01 18:06:34.349560 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.349557    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13354h46m19.972426911s"
Jul 01 18:06:34.421669 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.421584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:34.421827 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:34.421714    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:34.436145 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.436101    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cpbss" event={"ID":"a790c2fc-ab73-4563-ba30-750c24832b46","Type":"ContainerStarted","Data":"aad23e1e825690b22ee2c409bc4f14510bb1dfbc6fecb37c580bd7fe6f1336ba"}
Jul 01 18:06:34.440625 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.440590    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gq6w6" event={"ID":"c1d599f9-956d-4ac5-81c3-c1b9351e30a8","Type":"ContainerStarted","Data":"09dce7244f4bb32c66479b530d2229d2bb9a9723924de0a01cf08410989b5cba"}
Jul 01 18:06:34.449079 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.448990    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" event={"ID":"3da39a8b-9978-4ebf-9f87-f2387c65185e","Type":"ContainerStarted","Data":"6ec58ca6ec7b03bb42df0bdf670d8a0b493fc787da7df4096fc87ed70fd4cedd"}
Jul 01 18:06:34.460922 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.460891    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stdmb" event={"ID":"31142a55-0cf1-4ec1-aecb-625cf095258f","Type":"ContainerStarted","Data":"2a61a69b5f33df485e1a2444366c7156deca4fc49e75d63bc36b32661021d327"}
Jul 01 18:06:34.464328 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.464229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s" event={"ID":"0612bebc-667e-4ebe-a969-a6a607e61612","Type":"ContainerStarted","Data":"3d8132162f61c8c4c9c80ee98e4d7675272b8396adb13c4904b51195d91bcdd1"}
Jul 01 18:06:34.465924 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.465897    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5vlp" event={"ID":"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b","Type":"ContainerStarted","Data":"06382f09c6d5c7d8f33ac92a89d79cec423365a679d3e074ed3f19780f23aedd"}
Jul 01 18:06:34.470280 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.470254    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4xrhm" event={"ID":"38b432e2-719c-43e1-b685-fa97ebd5ad32","Type":"ContainerStarted","Data":"a845bcd906e257ab5b470db253aa9a1719c83581bce4a24f71f06f58d60c7576"}
Jul 01 18:06:34.471922 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.471900    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-28ftw" event={"ID":"cd95642d-fd67-4914-8f8e-2a1b1efd9e99","Type":"ContainerStarted","Data":"49e42d90af50389dc206a9194326a82c741034d68d4c5a02b33193acaa99f06e"}
Jul 01 18:06:34.475756 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.475713    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerStarted","Data":"12b859292da47d32dc079d03bf710e5a26de8cebb0d147fdef272c13bd3e7df5"}
Jul 01 18:06:34.481320 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.481295    2567 generic.go:356] "Generic (PLEG): container finished" podID="5fdc564b01e47bd6f5426b018ec2e9c6" containerID="16d5a5d430d7cb022f997e6627eb643e44e980478a87954fd17f798a46dc263c" exitCode=0
Jul 01 18:06:34.481414 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.481337    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal" event={"ID":"5fdc564b01e47bd6f5426b018ec2e9c6","Type":"ContainerDied","Data":"16d5a5d430d7cb022f997e6627eb643e44e980478a87954fd17f798a46dc263c"}
Jul 01 18:06:34.935642 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.935388    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:34.935809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.935698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:34.935809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:34.935732    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:34.935933 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:34.935870    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:34.935933 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:34.935932    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs podName:bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb nodeName:}" failed. No retries permitted until 2026-07-01 18:06:36.935915191 +0000 UTC m=+6.165988009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs") pod "network-metrics-daemon-ccl99" (UID: "bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:34.936385 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:34.936364    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:06:34.936466 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:34.936393    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:06:34.936466 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:34.936408    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sggdm for pod openshift-network-diagnostics/network-check-target-h84lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:34.936466 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:34.936457    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm podName:ab32ca0a-ddca-440f-8ec3-1344e2586896 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:36.93644193 +0000 UTC m=+6.166514767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sggdm" (UniqueName: "kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm") pod "network-check-target-h84lh" (UID: "ab32ca0a-ddca-440f-8ec3-1344e2586896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:34.936633 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:34.936527    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:34.936633 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:34.936558    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret podName:75251e3f-b5d0-4ba0-8ccf-9af0898a0b09 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:36.93654858 +0000 UTC m=+6.166621393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret") pod "global-pull-secret-syncer-4hhs2" (UID: "75251e3f-b5d0-4ba0-8ccf-9af0898a0b09") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:35.350724 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:35.350634    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:01:33 +0000 UTC" deadline="2028-03-09 09:04:48.348357238 +0000 UTC"
Jul 01 18:06:35.350724 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:35.350675    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14798h58m12.997685569s"
Jul 01 18:06:35.422404 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:35.422376    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:35.422556 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:35.422519    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:35.424201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:35.424025    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:35.424201 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:35.424140    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:35.502612 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:35.501811    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal" event={"ID":"5fdc564b01e47bd6f5426b018ec2e9c6","Type":"ContainerStarted","Data":"0f789c3cf3273a24140f8720dc136fc4786ab3c7176e6b437260fb64473ce65b"}
Jul 01 18:06:36.421838 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:36.420970    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:36.421838 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:36.421105    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:36.953608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:36.953567    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:36.953808 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:36.953648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:36.953808 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:36.953679    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:36.953936 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:36.953815    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:36.953936 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:36.953877    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs podName:bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb nodeName:}" failed. No retries permitted until 2026-07-01 18:06:40.95385886 +0000 UTC m=+10.183931676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs") pod "network-metrics-daemon-ccl99" (UID: "bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:36.954357 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:36.954337    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:36.954456 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:36.954395    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret podName:75251e3f-b5d0-4ba0-8ccf-9af0898a0b09 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:40.954378869 +0000 UTC m=+10.184451686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret") pod "global-pull-secret-syncer-4hhs2" (UID: "75251e3f-b5d0-4ba0-8ccf-9af0898a0b09") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:36.954515 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:36.954476    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:06:36.954515 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:36.954491    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:06:36.954515 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:36.954502    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sggdm for pod openshift-network-diagnostics/network-check-target-h84lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:36.954733 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:36.954534    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm podName:ab32ca0a-ddca-440f-8ec3-1344e2586896 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:40.954523534 +0000 UTC m=+10.184596349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sggdm" (UniqueName: "kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm") pod "network-check-target-h84lh" (UID: "ab32ca0a-ddca-440f-8ec3-1344e2586896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:37.422526 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:37.422363    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:37.422526 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:37.422385    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:37.422526 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:37.422502    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:37.423073 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:37.422879    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:38.421103 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:38.421070    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:38.421314 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:38.421193    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:39.421892 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:39.421866    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:39.422480 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:39.421865    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:39.422480 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:39.422004    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:39.422480 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:39.422084    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:40.420829 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:40.420798    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:40.421055 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:40.420923    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:40.992260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:40.992321    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:40.992379    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:40.992443    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:40.992499    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:40.992520    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:40.992543    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sggdm for pod openshift-network-diagnostics/network-check-target-h84lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:40.992519    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs podName:bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb nodeName:}" failed. No retries permitted until 2026-07-01 18:06:48.99249834 +0000 UTC m=+18.222571154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs") pod "network-metrics-daemon-ccl99" (UID: "bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:40.992637    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:40.992661    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm podName:ab32ca0a-ddca-440f-8ec3-1344e2586896 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:48.99264254 +0000 UTC m=+18.222715360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sggdm" (UniqueName: "kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm") pod "network-check-target-h84lh" (UID: "ab32ca0a-ddca-440f-8ec3-1344e2586896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:40.992683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:40.992676    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret podName:75251e3f-b5d0-4ba0-8ccf-9af0898a0b09 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:48.992668496 +0000 UTC m=+18.222741307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret") pod "global-pull-secret-syncer-4hhs2" (UID: "75251e3f-b5d0-4ba0-8ccf-9af0898a0b09") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:41.422413 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:41.422375    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:41.422600 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:41.422499    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:41.422600 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:41.422555    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:41.422600 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:41.422576    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:42.421650 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:42.421572    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:42.422080 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:42.421704    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:43.421542 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:43.421508    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:43.421726 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:43.421508    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:43.421726 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:43.421649    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:43.421726 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:43.421709    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:44.421090 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:44.421057    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:44.421232 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:44.421163    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:45.421005 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:45.420960    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:45.421405 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:45.421109    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:45.421405 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:45.421155    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:45.421405 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:45.421267    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:46.421325 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:46.421291    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:46.421766 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:46.421401    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:47.421233 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:47.421196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:47.421421 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:47.421231    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:47.421421 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:47.421357    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:47.421792 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:47.421468    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:48.421155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:48.421122    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:48.421442 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:48.421263    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:49.048674 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:49.048636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:49.048865 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:49.048686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:49.048865 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:49.048726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:49.048865 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.048792    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:06:49.048865 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.048813    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:06:49.048865 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.048826    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:49.049125 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.048861    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:49.049125 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.048877    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret podName:75251e3f-b5d0-4ba0-8ccf-9af0898a0b09 nodeName:}" failed. No retries permitted until 2026-07-01 18:07:05.048863937 +0000 UTC m=+34.278936763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret") pod "global-pull-secret-syncer-4hhs2" (UID: "75251e3f-b5d0-4ba0-8ccf-9af0898a0b09") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:06:49.049125 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.048827    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sggdm for pod openshift-network-diagnostics/network-check-target-h84lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:49.049125 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.048922    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs podName:bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb nodeName:}" failed. No retries permitted until 2026-07-01 18:07:05.048903947 +0000 UTC m=+34.278976766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs") pod "network-metrics-daemon-ccl99" (UID: "bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:06:49.049125 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.048946    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm podName:ab32ca0a-ddca-440f-8ec3-1344e2586896 nodeName:}" failed. No retries permitted until 2026-07-01 18:07:05.048934446 +0000 UTC m=+34.279007258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sggdm" (UniqueName: "kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm") pod "network-check-target-h84lh" (UID: "ab32ca0a-ddca-440f-8ec3-1344e2586896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:06:49.421928 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:49.421849    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:49.422390 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.421965    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:49.422390 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:49.422016    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:49.422390 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:49.422105    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:50.420849 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:50.420813    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:50.421029 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:50.420925    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:51.421805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:51.421729    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:51.422281 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:51.421856    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:51.422281 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:51.421918    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:51.422281 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:51.422050    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:52.420832 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:52.420797    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:52.421002 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:52.420919    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:53.421719 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:53.421691    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:53.422159 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:53.421798    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:53.422159 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:53.421861    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:53.422159 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:53.421966    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:54.421602 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.421430    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:54.421751 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:54.421674    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:54.539518 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.539487    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s" event={"ID":"0612bebc-667e-4ebe-a969-a6a607e61612","Type":"ContainerStarted","Data":"dc1f3beadf73c8619d6f9d8e628e9fad5dcca868066bbc171bfec5a6d46be9ec"}
Jul 01 18:06:54.540837 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.540815    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5vlp" event={"ID":"eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b","Type":"ContainerStarted","Data":"30e94c812f417599e53b597fddeb5be9b8b25e351288ff14ab216e91890eddc2"}
Jul 01 18:06:54.542116 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.542097    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4xrhm" event={"ID":"38b432e2-719c-43e1-b685-fa97ebd5ad32","Type":"ContainerStarted","Data":"6dbd4865da03fe5d80f6364709bf517e323481f81c13674c10c7a4ccc5afe917"}
Jul 01 18:06:54.543357 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.543330    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-28ftw" event={"ID":"cd95642d-fd67-4914-8f8e-2a1b1efd9e99","Type":"ContainerStarted","Data":"41ffba9cade829a804e1090f50e6d0d24cc4168f1d0d74eba8592425a16354af"}
Jul 01 18:06:54.545920 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.545903    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:06:54.546228 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.546211    2567 generic.go:356] "Generic (PLEG): container finished" podID="6b052a40-d97e-4085-a2b3-8ab15e1e87f0" containerID="e5b95547747bbaf2f4115b308fea3c1c35479b3d2bdc7999f5f842c8487a2aa4" exitCode=1
Jul 01 18:06:54.546303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.546284    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerStarted","Data":"abbdda8a1ba7de6cee684b1be80e92f3b9f16f71f4351802c320910c10d3ad73"}
Jul 01 18:06:54.546356 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.546341    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerStarted","Data":"2db939b0b19edc564580fa514c59a19a99b645b8abedd647888d92426db732d1"}
Jul 01 18:06:54.546399 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.546375    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerStarted","Data":"eb23ee521a942232d3218ceafe5fcef8f0cf511b2d54c57aac47b183d00a4a2c"}
Jul 01 18:06:54.546433 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.546404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerStarted","Data":"d36267d99725702e2d6c534173a248408c2072317e3066a1cfd43cf715be0326"}
Jul 01 18:06:54.546466 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.546442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerDied","Data":"e5b95547747bbaf2f4115b308fea3c1c35479b3d2bdc7999f5f842c8487a2aa4"}
Jul 01 18:06:54.546514 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.546476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerStarted","Data":"8a02c6280a4bef557d67f289d6770cb7e0a7287dc612768a92ed14ac3a1846a5"}
Jul 01 18:06:54.547557 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.547537    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal" event={"ID":"b0d496fb63956da7a6ed47cfee6c9f2e","Type":"ContainerStarted","Data":"9cd174f5e641e2c58aee8b8604f5f9e4671a3b07244705420c5f978c928a8b1f"}
Jul 01 18:06:54.548782 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.548762    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gq6w6" event={"ID":"c1d599f9-956d-4ac5-81c3-c1b9351e30a8","Type":"ContainerStarted","Data":"0e41d0153a985abe2b47beffe1b0b30c467cb2d64a173ffef350e9ece269d5dd"}
Jul 01 18:06:54.550022 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.550000    2567 generic.go:356] "Generic (PLEG): container finished" podID="3da39a8b-9978-4ebf-9f87-f2387c65185e" containerID="7b8148c7381690eb9432683c3599dc2abd6c19f6b6c58c0700b0252bf5e39b4f" exitCode=0
Jul 01 18:06:54.550106 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.550073    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" event={"ID":"3da39a8b-9978-4ebf-9f87-f2387c65185e","Type":"ContainerDied","Data":"7b8148c7381690eb9432683c3599dc2abd6c19f6b6c58c0700b0252bf5e39b4f"}
Jul 01 18:06:54.551299 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.551273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stdmb" event={"ID":"31142a55-0cf1-4ec1-aecb-625cf095258f","Type":"ContainerStarted","Data":"4e6507b6ad36eb19a4b436da4fff960a91455ea7fa51ed45ab55dc53272abd0e"}
Jul 01 18:06:54.557858 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.557809    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-171.ec2.internal" podStartSLOduration=22.557797396 podStartE2EDuration="22.557797396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:35.519603194 +0000 UTC m=+4.749676044" watchObservedRunningTime="2026-07-01 18:06:54.557797396 +0000 UTC m=+23.787870229"
Jul 01 18:06:54.557966 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.557949    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z5vlp" podStartSLOduration=3.7181086 podStartE2EDuration="23.557944448s" totalImagesPullingTime="19.839835848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:54.557705321 +0000 UTC m=+23.787778154" watchObservedRunningTime="2026-07-01 18:06:54.557944448 +0000 UTC m=+23.788017289"
Jul 01 18:06:54.570280 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.570226    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-171.ec2.internal" podStartSLOduration=22.570214928 podStartE2EDuration="22.570214928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:54.569860243 +0000 UTC m=+23.799933078" watchObservedRunningTime="2026-07-01 18:06:54.570214928 +0000 UTC m=+23.800287762"
Jul 01 18:06:54.586138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.586104    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4xrhm" podStartSLOduration=3.789992138 podStartE2EDuration="23.586093928s" totalImagesPullingTime="19.79610179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:54.585835094 +0000 UTC m=+23.815907929" watchObservedRunningTime="2026-07-01 18:06:54.586093928 +0000 UTC m=+23.816166762"
Jul 01 18:06:54.599899 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.599865    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gq6w6" podStartSLOduration=3.8178953939999998 podStartE2EDuration="23.599855021s" totalImagesPullingTime="19.781959627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:54.599358332 +0000 UTC m=+23.829431166" watchObservedRunningTime="2026-07-01 18:06:54.599855021 +0000 UTC m=+23.829927854"
Jul 01 18:06:54.638389 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.638350    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-stdmb" podStartSLOduration=8.073079252 podStartE2EDuration="23.638338895s" totalImagesPullingTime="15.565259643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:54.638211099 +0000 UTC m=+23.868283933" watchObservedRunningTime="2026-07-01 18:06:54.638338895 +0000 UTC m=+23.868411728"
Jul 01 18:06:54.656520 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.656481    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-28ftw" podStartSLOduration=3.865554829 podStartE2EDuration="23.656470608s" totalImagesPullingTime="19.790915779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:54.656331323 +0000 UTC m=+23.886404157" watchObservedRunningTime="2026-07-01 18:06:54.656470608 +0000 UTC m=+23.886543442"
Jul 01 18:06:54.669368 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.669346    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:54.730852 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:54.730826    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:55.420912 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:55.420879    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:55.420912 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:55.420918    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:55.421186 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:55.420997    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:55.421186 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:55.421162    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:55.554349 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:55.554314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cpbss" event={"ID":"a790c2fc-ab73-4563-ba30-750c24832b46","Type":"ContainerStarted","Data":"178078c90d74c62e4913c9fbbf5d621f84b7305b318a754dd616a5c8c6db943e"}
Jul 01 18:06:55.568432 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:55.568387    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cpbss" podStartSLOduration=4.776951027 podStartE2EDuration="24.568371691s" totalImagesPullingTime="19.791420664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:55.568088995 +0000 UTC m=+24.798161825" watchObservedRunningTime="2026-07-01 18:06:55.568371691 +0000 UTC m=+24.798444524"
Jul 01 18:06:55.694530 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:55.694444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:55.795889 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:55.795856    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:56.421082 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:56.421061    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:56.421192 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:56.421172    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:56.560824 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:56.560797    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:06:56.561228 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:56.561187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerStarted","Data":"2ea5b1658f2a9270b1e45f45e71c68002a688b8dbe968d78b35a58e4d5ee56cb"}
Jul 01 18:06:57.421882 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:57.421847    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:57.422052 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:57.421847    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:57.422052 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:57.421979    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:57.422052 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:57.422018    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:57.748567 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:57.748482    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:58.161471 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:58.161440    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:58.215852 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:58.215649    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:58.238582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:58.238554    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 01 18:06:58.420821 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:58.420755    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:06:58.420978 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:58.420846    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:06:58.436080 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:58.435993    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T18:06:58.238579901Z","UUID":"9e28adef-530a-47cb-83bc-16bae5fc2218","Handler":null,"Name":"","Endpoint":""}
Jul 01 18:06:58.437768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:58.437750    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 01 18:06:58.437870 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:58.437789    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 01 18:06:58.567896 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:58.567868    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s" event={"ID":"0612bebc-667e-4ebe-a969-a6a607e61612","Type":"ContainerStarted","Data":"0c9d016189f3d06789c25099c90e0b2d44c29e7194617f0a30e7c0e48cdc5856"}
Jul 01 18:06:58.572184 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:58.572166    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:06:59.147886 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.147788    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:59.203662 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.203615    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:59.421254 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.421222    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:06:59.421410 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:59.421390    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:06:59.421468 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.421453    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:06:59.421575 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:06:59.421547    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:06:59.427847 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.427786    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:59.428373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.428355    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:59.578114 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.578074    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s" event={"ID":"0612bebc-667e-4ebe-a969-a6a607e61612","Type":"ContainerStarted","Data":"5cc0d502c259283d92a7d1deb45ac74696b95fbbf1c74f784f4e08fb54fa39d5"}
Jul 01 18:06:59.581884 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.581861    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:06:59.582400 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.582338    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerStarted","Data":"753fee91466f0fa14c53e31c8beff576af4839a3f83bb958e1a95adcab00769c"}
Jul 01 18:06:59.582694 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.582662    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:59.582797 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.582752    2567 scope.go:117] "RemoveContainer" containerID="e5b95547747bbaf2f4115b308fea3c1c35479b3d2bdc7999f5f842c8487a2aa4"
Jul 01 18:06:59.582873 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.582755    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:59.583100 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.583087    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-stdmb"
Jul 01 18:06:59.599527 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.599191    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ftb7s" podStartSLOduration=3.448181288 podStartE2EDuration="28.599172978s" totalImagesPullingTime="25.15099169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:59.598751467 +0000 UTC m=+28.828824302" watchObservedRunningTime="2026-07-01 18:06:59.599172978 +0000 UTC m=+28.829245813"
Jul 01 18:06:59.600641 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.600618    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:59.601180 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.601161    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:06:59.673674 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.673468    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:59.840573 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.840507    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:06:59.924601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:06:59.924470    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:00.421681 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.421650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:00.422039 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:00.421789    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:07:00.511631 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.511601    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4hhs2"]
Jul 01 18:07:00.511782 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.511737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:07:00.511841 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:00.511823    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:07:00.515111 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.515076    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ccl99"]
Jul 01 18:07:00.515232 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.515191    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:07:00.515321 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:00.515302    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:07:00.515717 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.515697    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h84lh"]
Jul 01 18:07:00.588528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.588448    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:07:00.588898 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.588878    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:00.589012 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.588920    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" event={"ID":"6b052a40-d97e-4085-a2b3-8ab15e1e87f0","Type":"ContainerStarted","Data":"10efb0a526eaa7477a56e8e728dbcf2e56eb472d2aa9a027590f2002ed578ce3"}
Jul 01 18:07:00.589012 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.588979    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 01 18:07:00.589823 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:00.589583    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:07:00.623375 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.623330    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" podStartSLOduration=9.747860318 podStartE2EDuration="29.623314438s" totalImagesPullingTime="19.87545412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:07:00.621861336 +0000 UTC m=+29.851934172" watchObservedRunningTime="2026-07-01 18:07:00.623314438 +0000 UTC m=+29.853387250"
Jul 01 18:07:00.626524 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.626495    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:00.682036 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:00.681995    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:01.591987 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:01.591958    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 01 18:07:01.750269 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:01.750219    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:01.851204 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:01.851104    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:02.421130 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:02.421103    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:07:02.421262 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:02.421103    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:02.421262 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:02.421256    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:07:02.421348 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:02.421234    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:07:02.421385 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:02.421353    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:07:02.421437 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:02.421424    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:07:02.596726 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:02.596694    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" event={"ID":"3da39a8b-9978-4ebf-9f87-f2387c65185e","Type":"ContainerStarted","Data":"decface202ebcad2b29e044d96dbf166dc639beb6fd5ae5f754bcfa980c8ea68"}
Jul 01 18:07:03.351167 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:03.350971    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:07:03.351399 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:03.351387    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 01 18:07:03.363290 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:03.363254    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" podUID="6b052a40-d97e-4085-a2b3-8ab15e1e87f0" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 01 18:07:03.371254 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:03.371218    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf" podUID="6b052a40-d97e-4085-a2b3-8ab15e1e87f0" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 01 18:07:03.600539 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:03.600512    2567 generic.go:356] "Generic (PLEG): container finished" podID="3da39a8b-9978-4ebf-9f87-f2387c65185e" containerID="decface202ebcad2b29e044d96dbf166dc639beb6fd5ae5f754bcfa980c8ea68" exitCode=0
Jul 01 18:07:03.600898 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:03.600553    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" event={"ID":"3da39a8b-9978-4ebf-9f87-f2387c65185e","Type":"ContainerDied","Data":"decface202ebcad2b29e044d96dbf166dc639beb6fd5ae5f754bcfa980c8ea68"}
Jul 01 18:07:04.421422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:04.421392    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:04.421640 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:04.421483    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:07:04.421640 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:04.421489    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:07:04.421640 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:04.421531    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:07:04.421640 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:04.421618    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:07:04.421815 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:04.421710    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:07:05.064993 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:05.064966    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:05.065008    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:05.065049    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:05.065134    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:05.065157    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:05.065159    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:05.065168    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sggdm for pod openshift-network-diagnostics/network-check-target-h84lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:05.065161    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:05.065215    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs podName:bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb nodeName:}" failed. No retries permitted until 2026-07-01 18:07:37.065200486 +0000 UTC m=+66.295273298 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs") pod "network-metrics-daemon-ccl99" (UID: "bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:05.065235    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret podName:75251e3f-b5d0-4ba0-8ccf-9af0898a0b09 nodeName:}" failed. No retries permitted until 2026-07-01 18:07:37.06522017 +0000 UTC m=+66.295292984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret") pod "global-pull-secret-syncer-4hhs2" (UID: "75251e3f-b5d0-4ba0-8ccf-9af0898a0b09") : object "kube-system"/"original-pull-secret" not registered
Jul 01 18:07:05.065442 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:05.065261    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm podName:ab32ca0a-ddca-440f-8ec3-1344e2586896 nodeName:}" failed. No retries permitted until 2026-07-01 18:07:37.065255207 +0000 UTC m=+66.295328019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sggdm" (UniqueName: "kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm") pod "network-check-target-h84lh" (UID: "ab32ca0a-ddca-440f-8ec3-1344e2586896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 18:07:05.378665 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:05.378629    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:05.435538 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:05.435502    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:05.607363 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:05.607329    2567 generic.go:356] "Generic (PLEG): container finished" podID="3da39a8b-9978-4ebf-9f87-f2387c65185e" containerID="4482b635fe9bd4b172cd4e9c4b5928394f62d02a42c3f030eae93534e4a80c89" exitCode=0
Jul 01 18:07:05.607363 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:05.607368    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" event={"ID":"3da39a8b-9978-4ebf-9f87-f2387c65185e","Type":"ContainerDied","Data":"4482b635fe9bd4b172cd4e9c4b5928394f62d02a42c3f030eae93534e4a80c89"}
Jul 01 18:07:06.421429 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.421395    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:07:06.422052 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.421491    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:06.422052 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:06.421495    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4hhs2" podUID="75251e3f-b5d0-4ba0-8ccf-9af0898a0b09"
Jul 01 18:07:06.422052 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.421497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:07:06.422052 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:06.421569    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h84lh" podUID="ab32ca0a-ddca-440f-8ec3-1344e2586896"
Jul 01 18:07:06.422052 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:06.421644    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:07:06.516893 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.516818    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-171.ec2.internal" event="NodeReady"
Jul 01 18:07:06.517014 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.516931    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 01 18:07:06.559406 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.559374    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cwwp4"]
Jul 01 18:07:06.561089 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.561073    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.562261 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.562225    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9wd2p"]
Jul 01 18:07:06.563644 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.563624    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 01 18:07:06.563738 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.563661    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vsbfc\""
Jul 01 18:07:06.563805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.563781    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9wd2p"
Jul 01 18:07:06.563927 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.563896    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 01 18:07:06.566172 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.566119    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 01 18:07:06.566328 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.566310    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 01 18:07:06.566434 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.566348    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cl7bm\""
Jul 01 18:07:06.566434 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.566379    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 01 18:07:06.572678 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.572659    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9wd2p"]
Jul 01 18:07:06.577863 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.577844    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cwwp4"]
Jul 01 18:07:06.611584 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.611548    2567 generic.go:356] "Generic (PLEG): container finished" podID="3da39a8b-9978-4ebf-9f87-f2387c65185e" containerID="4af59a94d232c39a767243cb89242e448b97e714d8b11e96c4a2310c6f821ee2" exitCode=0
Jul 01 18:07:06.611753 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.611631    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" event={"ID":"3da39a8b-9978-4ebf-9f87-f2387c65185e","Type":"ContainerDied","Data":"4af59a94d232c39a767243cb89242e448b97e714d8b11e96c4a2310c6f821ee2"}
Jul 01 18:07:06.677040 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.677008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbnbd\" (UniqueName: \"kubernetes.io/projected/6f70f713-2706-4b59-ba5d-6969e783e7ab-kube-api-access-cbnbd\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.677040 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.677042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsj5f\" (UniqueName: \"kubernetes.io/projected/0a4a5924-1af3-4547-ac01-f9b9c2261553-kube-api-access-wsj5f\") pod \"ingress-canary-9wd2p\" (UID: \"0a4a5924-1af3-4547-ac01-f9b9c2261553\") " pod="openshift-ingress-canary/ingress-canary-9wd2p"
Jul 01 18:07:06.677285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.677061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.677285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.677118    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a4a5924-1af3-4547-ac01-f9b9c2261553-cert\") pod \"ingress-canary-9wd2p\" (UID: \"0a4a5924-1af3-4547-ac01-f9b9c2261553\") " pod="openshift-ingress-canary/ingress-canary-9wd2p"
Jul 01 18:07:06.677285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.677159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f70f713-2706-4b59-ba5d-6969e783e7ab-tmp-dir\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.677285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.677200    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f70f713-2706-4b59-ba5d-6969e783e7ab-config-volume\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.696052 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.696015    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:06.749794 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.749765    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:06.777929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.777900    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a4a5924-1af3-4547-ac01-f9b9c2261553-cert\") pod \"ingress-canary-9wd2p\" (UID: \"0a4a5924-1af3-4547-ac01-f9b9c2261553\") " pod="openshift-ingress-canary/ingress-canary-9wd2p"
Jul 01 18:07:06.778063 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.777970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f70f713-2706-4b59-ba5d-6969e783e7ab-tmp-dir\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.778134 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.778112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f70f713-2706-4b59-ba5d-6969e783e7ab-config-volume\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.778222 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.778205    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbnbd\" (UniqueName: \"kubernetes.io/projected/6f70f713-2706-4b59-ba5d-6969e783e7ab-kube-api-access-cbnbd\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.778339 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.778318    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f70f713-2706-4b59-ba5d-6969e783e7ab-tmp-dir\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.778413 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.778349    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsj5f\" (UniqueName: \"kubernetes.io/projected/0a4a5924-1af3-4547-ac01-f9b9c2261553-kube-api-access-wsj5f\") pod \"ingress-canary-9wd2p\" (UID: \"0a4a5924-1af3-4547-ac01-f9b9c2261553\") " pod="openshift-ingress-canary/ingress-canary-9wd2p"
Jul 01 18:07:06.778413 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.778386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.778506 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:06.778462    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:07:06.778555 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:06.778512    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls podName:6f70f713-2706-4b59-ba5d-6969e783e7ab nodeName:}" failed. No retries permitted until 2026-07-01 18:07:07.278495232 +0000 UTC m=+36.508568059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls") pod "dns-default-cwwp4" (UID: "6f70f713-2706-4b59-ba5d-6969e783e7ab") : secret "dns-default-metrics-tls" not found
Jul 01 18:07:06.778722 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.778704    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f70f713-2706-4b59-ba5d-6969e783e7ab-config-volume\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.782280 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.782257    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a4a5924-1af3-4547-ac01-f9b9c2261553-cert\") pod \"ingress-canary-9wd2p\" (UID: \"0a4a5924-1af3-4547-ac01-f9b9c2261553\") " pod="openshift-ingress-canary/ingress-canary-9wd2p"
Jul 01 18:07:06.786813 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.786787    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbnbd\" (UniqueName: \"kubernetes.io/projected/6f70f713-2706-4b59-ba5d-6969e783e7ab-kube-api-access-cbnbd\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:06.786912 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.786896    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsj5f\" (UniqueName: \"kubernetes.io/projected/0a4a5924-1af3-4547-ac01-f9b9c2261553-kube-api-access-wsj5f\") pod \"ingress-canary-9wd2p\" (UID: \"0a4a5924-1af3-4547-ac01-f9b9c2261553\") " pod="openshift-ingress-canary/ingress-canary-9wd2p"
Jul 01 18:07:06.877006 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:06.876970    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9wd2p"
Jul 01 18:07:07.008924 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:07.008690    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9wd2p"]
Jul 01 18:07:07.013049 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:07:07.013021    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4a5924_1af3_4547_ac01_f9b9c2261553.slice/crio-de07d529d1c2699b3f20a45ea112b956f2213a746c18e617048dcb4b1ec92d4c WatchSource:0}: Error finding container de07d529d1c2699b3f20a45ea112b956f2213a746c18e617048dcb4b1ec92d4c: Status 404 returned error can't find the container with id de07d529d1c2699b3f20a45ea112b956f2213a746c18e617048dcb4b1ec92d4c
Jul 01 18:07:07.282365 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:07.282335    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:07.282550 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:07.282475    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:07:07.282604 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:07.282558    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls podName:6f70f713-2706-4b59-ba5d-6969e783e7ab nodeName:}" failed. No retries permitted until 2026-07-01 18:07:08.282533755 +0000 UTC m=+37.512606573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls") pod "dns-default-cwwp4" (UID: "6f70f713-2706-4b59-ba5d-6969e783e7ab") : secret "dns-default-metrics-tls" not found
Jul 01 18:07:07.615202 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:07.615125    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9wd2p" event={"ID":"0a4a5924-1af3-4547-ac01-f9b9c2261553","Type":"ContainerStarted","Data":"de07d529d1c2699b3f20a45ea112b956f2213a746c18e617048dcb4b1ec92d4c"}
Jul 01 18:07:08.289761 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.289727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:08.289936 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:08.289856    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:07:08.289936 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:08.289921    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls podName:6f70f713-2706-4b59-ba5d-6969e783e7ab nodeName:}" failed. No retries permitted until 2026-07-01 18:07:10.289901366 +0000 UTC m=+39.519974202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls") pod "dns-default-cwwp4" (UID: "6f70f713-2706-4b59-ba5d-6969e783e7ab") : secret "dns-default-metrics-tls" not found
Jul 01 18:07:08.421666 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.421632    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:07:08.421850 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.421685    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:07:08.421850 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.421650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:08.424700 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.424680    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 18:07:08.425879 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.425658    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 18:07:08.425879 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.425764    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 18:07:08.426032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.425907    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdj6p\""
Jul 01 18:07:08.426032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.425985    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bhlcl\""
Jul 01 18:07:08.426032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:08.425992    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 18:07:09.701468 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:09.701430    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:09.802016 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:09.801929    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:10.305606 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:10.305568    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:10.305788 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:10.305744    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:07:10.305854 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:10.305825    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls podName:6f70f713-2706-4b59-ba5d-6969e783e7ab nodeName:}" failed. No retries permitted until 2026-07-01 18:07:14.305802684 +0000 UTC m=+43.535875497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls") pod "dns-default-cwwp4" (UID: "6f70f713-2706-4b59-ba5d-6969e783e7ab") : secret "dns-default-metrics-tls" not found
Jul 01 18:07:11.077852 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:11.077818    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:11.260900 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:11.260834    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:11.630744 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:11.630650    2567 generic.go:356] "Generic (PLEG): container finished" podID="3da39a8b-9978-4ebf-9f87-f2387c65185e" containerID="79607b47892d92ad2afab9e4e024178a67b8d60e49f09ed1b4c068dc57d9f735" exitCode=0
Jul 01 18:07:11.630920 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:11.630741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" event={"ID":"3da39a8b-9978-4ebf-9f87-f2387c65185e","Type":"ContainerDied","Data":"79607b47892d92ad2afab9e4e024178a67b8d60e49f09ed1b4c068dc57d9f735"}
Jul 01 18:07:11.632134 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:11.632108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9wd2p" event={"ID":"0a4a5924-1af3-4547-ac01-f9b9c2261553","Type":"ContainerStarted","Data":"b0c54fdeb9e91c69eeca1e8bce1ce03bc43f9e58a2a782432baa453a4758084b"}
Jul 01 18:07:11.666864 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:11.666807    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9wd2p" podStartSLOduration=1.4741910630000001 podStartE2EDuration="5.666784046s" totalImagesPullingTime="4.192592983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:07:11.665881903 +0000 UTC m=+40.895954738" watchObservedRunningTime="2026-07-01 18:07:11.666784046 +0000 UTC m=+40.896856881"
Jul 01 18:07:12.637072 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:12.637039    2567 generic.go:356] "Generic (PLEG): container finished" podID="3da39a8b-9978-4ebf-9f87-f2387c65185e" containerID="9fd6cd4cd2d26517df66d05701b7cbdbadb3fedadddac90a3c169a4319100ce6" exitCode=0
Jul 01 18:07:12.637477 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:12.637104    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" event={"ID":"3da39a8b-9978-4ebf-9f87-f2387c65185e","Type":"ContainerDied","Data":"9fd6cd4cd2d26517df66d05701b7cbdbadb3fedadddac90a3c169a4319100ce6"}
Jul 01 18:07:13.642492 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:13.642459    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" event={"ID":"3da39a8b-9978-4ebf-9f87-f2387c65185e","Type":"ContainerStarted","Data":"c5e0d392d91e0c45bb8f3d1189d29d7e763c0e9ccac9d9f02288cb4232997cca"}
Jul 01 18:07:13.664329 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:13.664277    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xhs4g" podStartSLOduration=8.636835131 podStartE2EDuration="42.664260731s" totalImagesPullingTime="34.0274256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:07:13.664225794 +0000 UTC m=+42.894298639" watchObservedRunningTime="2026-07-01 18:07:13.664260731 +0000 UTC m=+42.894333559"
Jul 01 18:07:13.783690 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:13.783653    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:13.920703 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:13.920607    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:14.335131 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:14.335095    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:14.335285 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:14.335267    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:07:14.335338 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:14.335331    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls podName:6f70f713-2706-4b59-ba5d-6969e783e7ab nodeName:}" failed. No retries permitted until 2026-07-01 18:07:22.335313372 +0000 UTC m=+51.565386185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls") pod "dns-default-cwwp4" (UID: "6f70f713-2706-4b59-ba5d-6969e783e7ab") : secret "dns-default-metrics-tls" not found
Jul 01 18:07:19.113740 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:19.113704    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:19.180285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:19.180233    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:22.389736 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:22.389696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:22.390115 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:22.389818    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:07:22.390115 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:22.389875    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls podName:6f70f713-2706-4b59-ba5d-6969e783e7ab nodeName:}" failed. No retries permitted until 2026-07-01 18:07:38.389858745 +0000 UTC m=+67.619931577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls") pod "dns-default-cwwp4" (UID: "6f70f713-2706-4b59-ba5d-6969e783e7ab") : secret "dns-default-metrics-tls" not found
Jul 01 18:07:26.672946 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:26.672915    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:26.792646 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:26.792610    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:33.372935 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:33.372908    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kc7vf"
Jul 01 18:07:33.549144 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:33.549107    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:33.603267 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:33.603196    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:37.092954 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.092916    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:37.092954 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.092954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:07:37.093399 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.092993    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:07:37.096370 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.096344    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 18:07:37.096726 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.096358    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 18:07:37.097021 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.096382    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 18:07:37.104192 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:37.104169    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 01 18:07:37.104312 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:37.104256    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs podName:bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb nodeName:}" failed. No retries permitted until 2026-07-01 18:08:41.104222143 +0000 UTC m=+130.334294955 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs") pod "network-metrics-daemon-ccl99" (UID: "bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb") : secret "metrics-daemon-secret" not found
Jul 01 18:07:37.106557 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.106537    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 18:07:37.107412 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.107393    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75251e3f-b5d0-4ba0-8ccf-9af0898a0b09-original-pull-secret\") pod \"global-pull-secret-syncer-4hhs2\" (UID: \"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09\") " pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:07:37.116420 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.116401    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sggdm\" (UniqueName: \"kubernetes.io/projected/ab32ca0a-ddca-440f-8ec3-1344e2586896-kube-api-access-sggdm\") pod \"network-check-target-h84lh\" (UID: \"ab32ca0a-ddca-440f-8ec3-1344e2586896\") " pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:37.247815 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.247787    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdj6p\""
Jul 01 18:07:37.250616 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.250600    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4hhs2"
Jul 01 18:07:37.255506 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.255490    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:37.386665 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.386634    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4hhs2"]
Jul 01 18:07:37.390664 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:07:37.390641    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75251e3f_b5d0_4ba0_8ccf_9af0898a0b09.slice/crio-9044fa87bd930b3b6af3c2b2bb2bfc5afdf884646d968bb9094aa0f74b46bdce WatchSource:0}: Error finding container 9044fa87bd930b3b6af3c2b2bb2bfc5afdf884646d968bb9094aa0f74b46bdce: Status 404 returned error can't find the container with id 9044fa87bd930b3b6af3c2b2bb2bfc5afdf884646d968bb9094aa0f74b46bdce
Jul 01 18:07:37.402373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.402348    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h84lh"]
Jul 01 18:07:37.405443 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:07:37.405418    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab32ca0a_ddca_440f_8ec3_1344e2586896.slice/crio-3ee63a965e832d477a5f8716125a859e13a335c07cebb33454ffe439baa1dbcf WatchSource:0}: Error finding container 3ee63a965e832d477a5f8716125a859e13a335c07cebb33454ffe439baa1dbcf: Status 404 returned error can't find the container with id 3ee63a965e832d477a5f8716125a859e13a335c07cebb33454ffe439baa1dbcf
Jul 01 18:07:37.700404 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.700311    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h84lh" event={"ID":"ab32ca0a-ddca-440f-8ec3-1344e2586896","Type":"ContainerStarted","Data":"3ee63a965e832d477a5f8716125a859e13a335c07cebb33454ffe439baa1dbcf"}
Jul 01 18:07:37.701208 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:37.701186    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4hhs2" event={"ID":"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09","Type":"ContainerStarted","Data":"9044fa87bd930b3b6af3c2b2bb2bfc5afdf884646d968bb9094aa0f74b46bdce"}
Jul 01 18:07:38.402613 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:38.402572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:07:38.403077 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:38.402741    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:07:38.403077 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:07:38.402822    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls podName:6f70f713-2706-4b59-ba5d-6969e783e7ab nodeName:}" failed. No retries permitted until 2026-07-01 18:08:10.402800963 +0000 UTC m=+99.632873783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls") pod "dns-default-cwwp4" (UID: "6f70f713-2706-4b59-ba5d-6969e783e7ab") : secret "dns-default-metrics-tls" not found
Jul 01 18:07:42.716647 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:42.716609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h84lh" event={"ID":"ab32ca0a-ddca-440f-8ec3-1344e2586896","Type":"ContainerStarted","Data":"92e3dc1a56681b180635d10422f4519248e1e432a716be83c915fccc726c7111"}
Jul 01 18:07:42.717106 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:42.716723    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:07:42.718066 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:42.718041    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4hhs2" event={"ID":"75251e3f-b5d0-4ba0-8ccf-9af0898a0b09","Type":"ContainerStarted","Data":"a5ba2df99978bc4f57f64d3a1a5a38ed7c1738d30336f7bed413ff7a2dfc07d1"}
Jul 01 18:07:42.733130 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:42.733092    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h84lh" podStartSLOduration=67.210424531 podStartE2EDuration="1m11.733080801s" totalImagesPullingTime="4.52265627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:07:42.732799251 +0000 UTC m=+71.962872097" watchObservedRunningTime="2026-07-01 18:07:42.733080801 +0000 UTC m=+71.963153636"
Jul 01 18:07:42.748856 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:42.748819    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4hhs2" podStartSLOduration=67.208168344 podStartE2EDuration="1m11.748807706s" totalImagesPullingTime="4.540639362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:07:42.748182913 +0000 UTC m=+71.978255747" watchObservedRunningTime="2026-07-01 18:07:42.748807706 +0000 UTC m=+71.978880541"
Jul 01 18:07:57.471158 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:57.471026    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:07:57.525573 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:07:57.525532    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:08:10.416191 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:08:10.416085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:08:10.416557 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:08:10.416255    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:08:10.416557 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:08:10.416331    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls podName:6f70f713-2706-4b59-ba5d-6969e783e7ab nodeName:}" failed. No retries permitted until 2026-07-01 18:09:14.416314354 +0000 UTC m=+163.646387168 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls") pod "dns-default-cwwp4" (UID: "6f70f713-2706-4b59-ba5d-6969e783e7ab") : secret "dns-default-metrics-tls" not found
Jul 01 18:08:13.722363 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:08:13.722335    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h84lh"
Jul 01 18:08:41.124446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:08:41.124392    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:08:41.124866 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:08:41.124528    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 01 18:08:41.124866 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:08:41.124595    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs podName:bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb nodeName:}" failed. No retries permitted until 2026-07-01 18:10:43.124579678 +0000 UTC m=+252.354652491 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs") pod "network-metrics-daemon-ccl99" (UID: "bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb") : secret "metrics-daemon-secret" not found
Jul 01 18:09:09.571320 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:09:09.571277    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cwwp4" podUID="6f70f713-2706-4b59-ba5d-6969e783e7ab"
Jul 01 18:09:09.926325 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:09:09.926226    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:09:11.436188 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:09:11.436153    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ccl99" podUID="bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb"
Jul 01 18:09:14.455276 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:09:14.455228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:09:14.455623 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:09:14.455371    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 01 18:09:14.455623 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:09:14.455434    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls podName:6f70f713-2706-4b59-ba5d-6969e783e7ab nodeName:}" failed. No retries permitted until 2026-07-01 18:11:16.455418124 +0000 UTC m=+285.685490936 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls") pod "dns-default-cwwp4" (UID: "6f70f713-2706-4b59-ba5d-6969e783e7ab") : secret "dns-default-metrics-tls" not found
Jul 01 18:09:26.421481 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:09:26.421399    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:09:37.376256 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:09:37.376203    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:03.497145 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.497113    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg"]
Jul 01 18:10:03.498962 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.498948    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg"
Jul 01 18:10:03.501738 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.501712    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 01 18:10:03.501738 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.501735    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 01 18:10:03.502777 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.502761    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n9rtg\""
Jul 01 18:10:03.510333 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.510310    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-4f67x"]
Jul 01 18:10:03.511927 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.511913    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7847598fbb-mpv64"]
Jul 01 18:10:03.512043 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.512028    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.513550 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.513534    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.515958 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.515920    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg"]
Jul 01 18:10:03.516326 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.516307    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 01 18:10:03.516849 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.516831    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 01 18:10:03.516946 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.516875    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 01 18:10:03.516946 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.516883    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-86d4l\""
Jul 01 18:10:03.517301 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.517278    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 01 18:10:03.517399 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.517299    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 01 18:10:03.520112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.520090    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 01 18:10:03.521340 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.521321    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-s4prv\""
Jul 01 18:10:03.521572 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.521556    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 01 18:10:03.525532 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.525513    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 01 18:10:03.526737 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.526715    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 01 18:10:03.534033 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.534013    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-4f67x"]
Jul 01 18:10:03.539318 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.539295    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7847598fbb-mpv64"]
Jul 01 18:10:03.583720 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.583682    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-trusted-ca\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.583890 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.583736    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-image-registry-private-configuration\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.583890 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.583763    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/007fc588-afb3-4c42-b282-e1204664a892-config\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.583890 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.583807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/007fc588-afb3-4c42-b282-e1204664a892-trusted-ca\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.583890 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.583830    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-ca-trust-extracted\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.583890 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.583858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfvqz\" (UniqueName: \"kubernetes.io/projected/01cf60b3-0ec9-420e-9ba9-751f019fa20e-kube-api-access-cfvqz\") pod \"volume-data-source-validator-69d9f679db-h72lg\" (UID: \"01cf60b3-0ec9-420e-9ba9-751f019fa20e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg"
Jul 01 18:10:03.584150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.583909    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kdn8\" (UniqueName: \"kubernetes.io/projected/007fc588-afb3-4c42-b282-e1204664a892-kube-api-access-6kdn8\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.584150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.583951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-installation-pull-secrets\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.584150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.583974    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-bound-sa-token\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.584150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.584033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/007fc588-afb3-4c42-b282-e1204664a892-serving-cert\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.584150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.584068    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-certificates\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.584150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.584097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpnjh\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-kube-api-access-bpnjh\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.584150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.584125    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.597485 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.597453    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-xhl25"]
Jul 01 18:10:03.599940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.599907    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-pcmfc"]
Jul 01 18:10:03.600070 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.600026    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-xhl25"
Jul 01 18:10:03.601581 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.601557    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"]
Jul 01 18:10:03.601683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.601672    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.603214 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.603197    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.604582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.604561    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 01 18:10:03.604683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.604576    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gg97q\""
Jul 01 18:10:03.604683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.604623    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 01 18:10:03.604683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.604595    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 01 18:10:03.605104 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.605087    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 01 18:10:03.605334 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.605319    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zcpd9\""
Jul 01 18:10:03.605511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.605491    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 01 18:10:03.605678 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.605663    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 01 18:10:03.605864 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.605852    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 01 18:10:03.606125 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.606109    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 01 18:10:03.606631 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.606614    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jj24c\""
Jul 01 18:10:03.613254 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.613214    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 01 18:10:03.614527 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.614027    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-xhl25"]
Jul 01 18:10:03.615058 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.615039    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"]
Jul 01 18:10:03.619027 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.619004    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-pcmfc"]
Jul 01 18:10:03.685100 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpnjh\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-kube-api-access-bpnjh\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.685286 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685099    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/007fc588-afb3-4c42-b282-e1204664a892-config\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.685286 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.685286 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685264    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-trusted-ca\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.685422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/007fc588-afb3-4c42-b282-e1204664a892-trusted-ca\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.685422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kdn8\" (UniqueName: \"kubernetes.io/projected/007fc588-afb3-4c42-b282-e1204664a892-kube-api-access-6kdn8\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.685422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfvqz\" (UniqueName: \"kubernetes.io/projected/01cf60b3-0ec9-420e-9ba9-751f019fa20e-kube-api-access-cfvqz\") pod \"volume-data-source-validator-69d9f679db-h72lg\" (UID: \"01cf60b3-0ec9-420e-9ba9-751f019fa20e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg"
Jul 01 18:10:03.685577 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685506    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/007fc588-afb3-4c42-b282-e1204664a892-serving-cert\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.685577 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685538    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.685683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685584    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-service-ca-bundle\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.685683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:03.685618    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:10:03.685683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clvzp\" (UniqueName: \"kubernetes.io/projected/dba92742-325f-4d75-9e60-aa6550511df1-kube-api-access-clvzp\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wrcrn\" (UID: \"dba92742-325f-4d75-9e60-aa6550511df1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.685683 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:03.685632    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7847598fbb-mpv64: secret "image-registry-tls" not found
Jul 01 18:10:03.685683 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685655    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-snapshots\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:03.685695    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls podName:b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:04.185675157 +0000 UTC m=+213.415747984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls") pod "image-registry-7847598fbb-mpv64" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1") : secret "image-registry-tls" not found
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685710    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-tmp\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685755    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-installation-pull-secrets\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685781    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-bound-sa-token\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-serving-cert\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685841    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dba92742-325f-4d75-9e60-aa6550511df1-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wrcrn\" (UID: \"dba92742-325f-4d75-9e60-aa6550511df1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685868    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-ca-trust-extracted\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685901    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9vx9\" (UniqueName: \"kubernetes.io/projected/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-kube-api-access-t9vx9\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685907    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/007fc588-afb3-4c42-b282-e1204664a892-config\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.685929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685925    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klxf5\" (UniqueName: \"kubernetes.io/projected/c0ba9fdb-456b-4f04-9906-ce72a74e10da-kube-api-access-klxf5\") pod \"network-check-source-56499946bc-xhl25\" (UID: \"c0ba9fdb-456b-4f04-9906-ce72a74e10da\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-xhl25"
Jul 01 18:10:03.686582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-certificates\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.686582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.685994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dba92742-325f-4d75-9e60-aa6550511df1-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wrcrn\" (UID: \"dba92742-325f-4d75-9e60-aa6550511df1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.686582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.686039    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-image-registry-private-configuration\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.686582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.686270    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-trusted-ca\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.686582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.686303    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/007fc588-afb3-4c42-b282-e1204664a892-trusted-ca\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.686582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.686443    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-ca-trust-extracted\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.686582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.686515    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-certificates\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.688038 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.688016    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/007fc588-afb3-4c42-b282-e1204664a892-serving-cert\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.688305 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.688288    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-installation-pull-secrets\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.688391 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.688290    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-image-registry-private-configuration\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.695696 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.695669    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-bound-sa-token\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.696009 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.695988    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfvqz\" (UniqueName: \"kubernetes.io/projected/01cf60b3-0ec9-420e-9ba9-751f019fa20e-kube-api-access-cfvqz\") pod \"volume-data-source-validator-69d9f679db-h72lg\" (UID: \"01cf60b3-0ec9-420e-9ba9-751f019fa20e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg"
Jul 01 18:10:03.696084 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.695990    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kdn8\" (UniqueName: \"kubernetes.io/projected/007fc588-afb3-4c42-b282-e1204664a892-kube-api-access-6kdn8\") pod \"console-operator-7fdbdf9c99-4f67x\" (UID: \"007fc588-afb3-4c42-b282-e1204664a892\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.696084 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.695988    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpnjh\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-kube-api-access-bpnjh\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:03.770826 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.770751    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:03.786867 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.786838    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-serving-cert\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.786958 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.786870    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dba92742-325f-4d75-9e60-aa6550511df1-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wrcrn\" (UID: \"dba92742-325f-4d75-9e60-aa6550511df1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.786958 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.786891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9vx9\" (UniqueName: \"kubernetes.io/projected/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-kube-api-access-t9vx9\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.787033 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.786999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klxf5\" (UniqueName: \"kubernetes.io/projected/c0ba9fdb-456b-4f04-9906-ce72a74e10da-kube-api-access-klxf5\") pod \"network-check-source-56499946bc-xhl25\" (UID: \"c0ba9fdb-456b-4f04-9906-ce72a74e10da\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-xhl25"
Jul 01 18:10:03.787075 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787034    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dba92742-325f-4d75-9e60-aa6550511df1-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wrcrn\" (UID: \"dba92742-325f-4d75-9e60-aa6550511df1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.787117 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787072    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.787163 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-service-ca-bundle\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.787216 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clvzp\" (UniqueName: \"kubernetes.io/projected/dba92742-325f-4d75-9e60-aa6550511df1-kube-api-access-clvzp\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wrcrn\" (UID: \"dba92742-325f-4d75-9e60-aa6550511df1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.787216 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-snapshots\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.787427 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-tmp\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.787686 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787661    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dba92742-325f-4d75-9e60-aa6550511df1-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wrcrn\" (UID: \"dba92742-325f-4d75-9e60-aa6550511df1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.787780 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787744    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-tmp\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.787845 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787825    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-service-ca-bundle\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.787962 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787945    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.788008 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.787949    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-snapshots\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.789274 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.789252    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dba92742-325f-4d75-9e60-aa6550511df1-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wrcrn\" (UID: \"dba92742-325f-4d75-9e60-aa6550511df1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.789360 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.789343    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-serving-cert\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.795621 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.795601    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clvzp\" (UniqueName: \"kubernetes.io/projected/dba92742-325f-4d75-9e60-aa6550511df1-kube-api-access-clvzp\") pod \"kube-storage-version-migrator-operator-79964ff6f9-wrcrn\" (UID: \"dba92742-325f-4d75-9e60-aa6550511df1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.795707 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.795645    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9vx9\" (UniqueName: \"kubernetes.io/projected/1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09-kube-api-access-t9vx9\") pod \"insights-operator-5f67b55555-pcmfc\" (UID: \"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09\") " pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.795750 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.795706    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klxf5\" (UniqueName: \"kubernetes.io/projected/c0ba9fdb-456b-4f04-9906-ce72a74e10da-kube-api-access-klxf5\") pod \"network-check-source-56499946bc-xhl25\" (UID: \"c0ba9fdb-456b-4f04-9906-ce72a74e10da\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-xhl25"
Jul 01 18:10:03.807533 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.807515    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg"
Jul 01 18:10:03.823326 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.823298    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:03.828488 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.828454    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:03.910715 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.910679    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-xhl25"
Jul 01 18:10:03.917431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.917398    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-pcmfc"
Jul 01 18:10:03.923771 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.923736    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"
Jul 01 18:10:03.935040 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.935014    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg"]
Jul 01 18:10:03.939870 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:03.939840    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01cf60b3_0ec9_420e_9ba9_751f019fa20e.slice/crio-9ffa4802c6dfd1de418d171e03f0a1fbcfab5e4d95ce12952f9c073734ad5666 WatchSource:0}: Error finding container 9ffa4802c6dfd1de418d171e03f0a1fbcfab5e4d95ce12952f9c073734ad5666: Status 404 returned error can't find the container with id 9ffa4802c6dfd1de418d171e03f0a1fbcfab5e4d95ce12952f9c073734ad5666
Jul 01 18:10:03.958923 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:03.958740    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-4f67x"]
Jul 01 18:10:03.962499 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:03.962466    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007fc588_afb3_4c42_b282_e1204664a892.slice/crio-c82fd52887ee328864adb872e2995b41f34e027d4e271afa18a15705073e4a97 WatchSource:0}: Error finding container c82fd52887ee328864adb872e2995b41f34e027d4e271afa18a15705073e4a97: Status 404 returned error can't find the container with id c82fd52887ee328864adb872e2995b41f34e027d4e271afa18a15705073e4a97
Jul 01 18:10:04.058529 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:04.058497    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-xhl25"]
Jul 01 18:10:04.059911 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:04.059874    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg" event={"ID":"01cf60b3-0ec9-420e-9ba9-751f019fa20e","Type":"ContainerStarted","Data":"9ffa4802c6dfd1de418d171e03f0a1fbcfab5e4d95ce12952f9c073734ad5666"}
Jul 01 18:10:04.061128 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:04.061100    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ba9fdb_456b_4f04_9906_ce72a74e10da.slice/crio-a51f92b2f93c477e92f6717310e403a988c66f12477105d605d40b1cbed9371a WatchSource:0}: Error finding container a51f92b2f93c477e92f6717310e403a988c66f12477105d605d40b1cbed9371a: Status 404 returned error can't find the container with id a51f92b2f93c477e92f6717310e403a988c66f12477105d605d40b1cbed9371a
Jul 01 18:10:04.061362 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:04.061338    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" event={"ID":"007fc588-afb3-4c42-b282-e1204664a892","Type":"ContainerStarted","Data":"c82fd52887ee328864adb872e2995b41f34e027d4e271afa18a15705073e4a97"}
Jul 01 18:10:04.072885 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:04.072839    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-pcmfc"]
Jul 01 18:10:04.079606 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:04.079577    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4ecdb7_dfd0_41ea_85c9_6f767d80bd09.slice/crio-7bf40641130359ff20aaa17653bc66956e883ce362ba17b2570ec9a40ae66a01 WatchSource:0}: Error finding container 7bf40641130359ff20aaa17653bc66956e883ce362ba17b2570ec9a40ae66a01: Status 404 returned error can't find the container with id 7bf40641130359ff20aaa17653bc66956e883ce362ba17b2570ec9a40ae66a01
Jul 01 18:10:04.090026 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:04.089995    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn"]
Jul 01 18:10:04.190212 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:04.190168    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:04.190410 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:04.190341    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:10:04.190410 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:04.190362    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7847598fbb-mpv64: secret "image-registry-tls" not found
Jul 01 18:10:04.190493 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:04.190426    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls podName:b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:05.190409889 +0000 UTC m=+214.420482701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls") pod "image-registry-7847598fbb-mpv64" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1") : secret "image-registry-tls" not found
Jul 01 18:10:05.068891 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:05.068847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn" event={"ID":"dba92742-325f-4d75-9e60-aa6550511df1","Type":"ContainerStarted","Data":"ec0cb3be12dddcda6451a030d5aedc7686df080282856248414752238d28538c"}
Jul 01 18:10:05.069856 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:05.069836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-pcmfc" event={"ID":"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09","Type":"ContainerStarted","Data":"7bf40641130359ff20aaa17653bc66956e883ce362ba17b2570ec9a40ae66a01"}
Jul 01 18:10:05.071102 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:05.071082    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-xhl25" event={"ID":"c0ba9fdb-456b-4f04-9906-ce72a74e10da","Type":"ContainerStarted","Data":"5f512bc96ccb1c980628fa3cb1303f7591e51ffad896ce5083dc0906c384115c"}
Jul 01 18:10:05.071206 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:05.071116    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-xhl25" event={"ID":"c0ba9fdb-456b-4f04-9906-ce72a74e10da","Type":"ContainerStarted","Data":"a51f92b2f93c477e92f6717310e403a988c66f12477105d605d40b1cbed9371a"}
Jul 01 18:10:05.087428 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:05.087381    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-xhl25" podStartSLOduration=2.087367135 podStartE2EDuration="2.087367135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:05.086499098 +0000 UTC m=+214.316571931" watchObservedRunningTime="2026-07-01 18:10:05.087367135 +0000 UTC m=+214.317439968"
Jul 01 18:10:05.198102 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:05.198050    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:05.198307 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:05.198211    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:10:05.198307 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:05.198233    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7847598fbb-mpv64: secret "image-registry-tls" not found
Jul 01 18:10:05.198424 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:05.198320    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls podName:b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:07.19829782 +0000 UTC m=+216.428370646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls") pod "image-registry-7847598fbb-mpv64" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1") : secret "image-registry-tls" not found
Jul 01 18:10:07.079495 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:07.079439    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg" event={"ID":"01cf60b3-0ec9-420e-9ba9-751f019fa20e","Type":"ContainerStarted","Data":"05ed5357c0ffb6a8df8258efcd8df572123cfbe7a488e369624656ecb067c4c0"}
Jul 01 18:10:07.095075 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:07.095021    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-h72lg" podStartSLOduration=1.968056109 podStartE2EDuration="4.095000168s" totalImagesPullingTime="2.126944059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:07.094380124 +0000 UTC m=+216.324452960" watchObservedRunningTime="2026-07-01 18:10:07.095000168 +0000 UTC m=+216.325073004"
Jul 01 18:10:07.173309 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:07.173274    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:07.217693 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:07.217654    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:07.217866 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:07.217829    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:10:07.217866 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:07.217853    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7847598fbb-mpv64: secret "image-registry-tls" not found
Jul 01 18:10:07.217964 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:07.217922    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls podName:b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:11.217899383 +0000 UTC m=+220.447972210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls") pod "image-registry-7847598fbb-mpv64" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1") : secret "image-registry-tls" not found
Jul 01 18:10:07.271855 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:07.271809    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:08.773596 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:08.773560    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:09.088445 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.088407    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-pcmfc" event={"ID":"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09","Type":"ContainerStarted","Data":"75bdd61e061106e97100602c2a4a0bf64002b22b752471dcd2caf4e0735c5dad"}
Jul 01 18:10:09.090039 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.090016    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/0.log"
Jul 01 18:10:09.090163 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.090058    2567 generic.go:356] "Generic (PLEG): container finished" podID="007fc588-afb3-4c42-b282-e1204664a892" containerID="10502b9380fc552ff468d9aa9cff1305aea0077cad90eaa113580514036e9d16" exitCode=255
Jul 01 18:10:09.090163 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.090143    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" event={"ID":"007fc588-afb3-4c42-b282-e1204664a892","Type":"ContainerDied","Data":"10502b9380fc552ff468d9aa9cff1305aea0077cad90eaa113580514036e9d16"}
Jul 01 18:10:09.090340 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.090325    2567 scope.go:117] "RemoveContainer" containerID="10502b9380fc552ff468d9aa9cff1305aea0077cad90eaa113580514036e9d16"
Jul 01 18:10:09.091589 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.091571    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn" event={"ID":"dba92742-325f-4d75-9e60-aa6550511df1","Type":"ContainerStarted","Data":"b5bba43a55d78ee8469c2949aafb3229e7aeee4f7b4904e235fa3266476b1855"}
Jul 01 18:10:09.106361 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.106304    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-pcmfc" podStartSLOduration=2.039400172 podStartE2EDuration="6.106284622s" totalImagesPullingTime="4.06688445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:09.10496897 +0000 UTC m=+218.335041815" watchObservedRunningTime="2026-07-01 18:10:09.106284622 +0000 UTC m=+218.336357457"
Jul 01 18:10:09.137619 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.137572    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn" podStartSLOduration=2.084789206 podStartE2EDuration="6.137556457s" totalImagesPullingTime="4.052767251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:09.136761754 +0000 UTC m=+218.366834590" watchObservedRunningTime="2026-07-01 18:10:09.137556457 +0000 UTC m=+218.367629290"
Jul 01 18:10:09.213694 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.213664    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:09.273670 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.273632    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:09.691267 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.691218    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:09.747180 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.747144    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:09.841722 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.841693    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nzwm7"]
Jul 01 18:10:09.843854 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.843830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:09.846494 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.846461    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 01 18:10:09.846494 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.846470    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9p988\""
Jul 01 18:10:09.846667 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.846508    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 01 18:10:09.857965 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.857937    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nzwm7"]
Jul 01 18:10:09.876198 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.876166    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:09.938749 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.938711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:09.938948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.938771    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-data-volume\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:09.938948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.938836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:09.938948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.938914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-crio-socket\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:09.938948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:09.938948    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrfg7\" (UniqueName: \"kubernetes.io/projected/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-api-access-jrfg7\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.040152 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.040121    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrfg7\" (UniqueName: \"kubernetes.io/projected/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-api-access-jrfg7\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.040357 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.040169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.040357 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.040205    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-data-volume\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.040357 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.040234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.040357 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.040283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-crio-socket\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.040357 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:10.040317    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:10.040357 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:10.040353    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:10:10.040645 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:10.040396    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:10.540373967 +0000 UTC m=+219.770446780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:10.040645 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:10.040417    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:10.540407711 +0000 UTC m=+219.770480526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : configmap "kube-rbac-proxy" not found
Jul 01 18:10:10.040645 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.040356    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-crio-socket\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.040645 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.040573    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-data-volume\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.048535 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.048502    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrfg7\" (UniqueName: \"kubernetes.io/projected/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-api-access-jrfg7\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.096795 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.096766    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/1.log"
Jul 01 18:10:10.097253 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.097223    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/0.log"
Jul 01 18:10:10.097330 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.097278    2567 generic.go:356] "Generic (PLEG): container finished" podID="007fc588-afb3-4c42-b282-e1204664a892" containerID="17623dfcf65d6cdb0b66165ebac1ff289b526703d2cb79130cf5735e53ce83c7" exitCode=255
Jul 01 18:10:10.097373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.097355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" event={"ID":"007fc588-afb3-4c42-b282-e1204664a892","Type":"ContainerDied","Data":"17623dfcf65d6cdb0b66165ebac1ff289b526703d2cb79130cf5735e53ce83c7"}
Jul 01 18:10:10.097412 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.097398    2567 scope.go:117] "RemoveContainer" containerID="10502b9380fc552ff468d9aa9cff1305aea0077cad90eaa113580514036e9d16"
Jul 01 18:10:10.097642 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.097608    2567 scope.go:117] "RemoveContainer" containerID="17623dfcf65d6cdb0b66165ebac1ff289b526703d2cb79130cf5735e53ce83c7"
Jul 01 18:10:10.097837 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:10.097816    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-4f67x_openshift-console-operator(007fc588-afb3-4c42-b282-e1204664a892)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" podUID="007fc588-afb3-4c42-b282-e1204664a892"
Jul 01 18:10:10.205829 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.205791    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:10.305752 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.305649    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:10.544774 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.544733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.544976 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:10.544808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:10.544976 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:10.544895    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:10.544976 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:10.544922    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:10:10.544976 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:10.544976    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:11.544954831 +0000 UTC m=+220.775027650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:10.545169 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:10.544997    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:11.544987339 +0000 UTC m=+220.775060151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : configmap "kube-rbac-proxy" not found
Jul 01 18:10:11.075080 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.075050    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"]
Jul 01 18:10:11.077666 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.077645    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.079978 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.079951    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 01 18:10:11.081033 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.081007    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 01 18:10:11.081112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.081042    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 01 18:10:11.081112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.081011    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2m2j9\""
Jul 01 18:10:11.081201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.081011    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 01 18:10:11.085504 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.085482    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"]
Jul 01 18:10:11.102588 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.102573    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/1.log"
Jul 01 18:10:11.102828 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.102816    2567 scope.go:117] "RemoveContainer" containerID="17623dfcf65d6cdb0b66165ebac1ff289b526703d2cb79130cf5735e53ce83c7"
Jul 01 18:10:11.102977 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:11.102961    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-4f67x_openshift-console-operator(007fc588-afb3-4c42-b282-e1204664a892)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" podUID="007fc588-afb3-4c42-b282-e1204664a892"
Jul 01 18:10:11.106054 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.106026    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:11.150152 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.150122    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cbnw\" (UniqueName: \"kubernetes.io/projected/84c84457-7593-452a-803e-066ec73f854d-kube-api-access-2cbnw\") pod \"service-ca-7bb4f4bcc7-k55ss\" (UID: \"84c84457-7593-452a-803e-066ec73f854d\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.150309 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.150157    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/84c84457-7593-452a-803e-066ec73f854d-signing-key\") pod \"service-ca-7bb4f4bcc7-k55ss\" (UID: \"84c84457-7593-452a-803e-066ec73f854d\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.150450 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.150427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/84c84457-7593-452a-803e-066ec73f854d-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-k55ss\" (UID: \"84c84457-7593-452a-803e-066ec73f854d\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.159838 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.159818    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:11.251025 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.251000    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/84c84457-7593-452a-803e-066ec73f854d-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-k55ss\" (UID: \"84c84457-7593-452a-803e-066ec73f854d\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.251163 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.251031    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:11.251163 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.251075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cbnw\" (UniqueName: \"kubernetes.io/projected/84c84457-7593-452a-803e-066ec73f854d-kube-api-access-2cbnw\") pod \"service-ca-7bb4f4bcc7-k55ss\" (UID: \"84c84457-7593-452a-803e-066ec73f854d\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.251163 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.251096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/84c84457-7593-452a-803e-066ec73f854d-signing-key\") pod \"service-ca-7bb4f4bcc7-k55ss\" (UID: \"84c84457-7593-452a-803e-066ec73f854d\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.251337 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:11.251286    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 01 18:10:11.251337 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:11.251305    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7847598fbb-mpv64: secret "image-registry-tls" not found
Jul 01 18:10:11.251431 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:11.251368    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls podName:b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:19.251345497 +0000 UTC m=+228.481418309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls") pod "image-registry-7847598fbb-mpv64" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1") : secret "image-registry-tls" not found
Jul 01 18:10:11.251667 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.251649    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/84c84457-7593-452a-803e-066ec73f854d-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-k55ss\" (UID: \"84c84457-7593-452a-803e-066ec73f854d\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.253358 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.253339    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/84c84457-7593-452a-803e-066ec73f854d-signing-key\") pod \"service-ca-7bb4f4bcc7-k55ss\" (UID: \"84c84457-7593-452a-803e-066ec73f854d\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.258738 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.258717    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cbnw\" (UniqueName: \"kubernetes.io/projected/84c84457-7593-452a-803e-066ec73f854d-kube-api-access-2cbnw\") pod \"service-ca-7bb4f4bcc7-k55ss\" (UID: \"84c84457-7593-452a-803e-066ec73f854d\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.386726 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.386633    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"
Jul 01 18:10:11.508482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.508454    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-k55ss"]
Jul 01 18:10:11.512313 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:11.512282    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c84457_7593_452a_803e_066ec73f854d.slice/crio-b8ca50cbfd6e67995b5d007037c85d4f311b75061442c2393014539fc3585e10 WatchSource:0}: Error finding container b8ca50cbfd6e67995b5d007037c85d4f311b75061442c2393014539fc3585e10: Status 404 returned error can't find the container with id b8ca50cbfd6e67995b5d007037c85d4f311b75061442c2393014539fc3585e10
Jul 01 18:10:11.553119 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.553093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:11.553263 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.553149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:11.553309 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:11.553267    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:10:11.553309 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:11.553273    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:11.553387 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:11.553319    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:13.553303844 +0000 UTC m=+222.783376659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : configmap "kube-rbac-proxy" not found
Jul 01 18:10:11.553387 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:11.553332    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:13.553326849 +0000 UTC m=+222.783399661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:11.830966 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:11.830939    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gq6w6_c1d599f9-956d-4ac5-81c3-c1b9351e30a8/dns-node-resolver/0.log"
Jul 01 18:10:12.107432 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:12.107354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss" event={"ID":"84c84457-7593-452a-803e-066ec73f854d","Type":"ContainerStarted","Data":"b8ca50cbfd6e67995b5d007037c85d4f311b75061442c2393014539fc3585e10"}
Jul 01 18:10:12.225410 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:12.225371    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:12.630273 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:12.630227    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-28ftw_cd95642d-fd67-4914-8f8e-2a1b1efd9e99/node-ca/0.log"
Jul 01 18:10:13.430232 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:13.430203    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9wd2p_0a4a5924-1af3-4547-ac01-f9b9c2261553/serve-healthcheck-canary/0.log"
Jul 01 18:10:13.569699 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:13.569657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:13.569894 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:13.569781    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:13.569894 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:13.569785    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:10:13.569894 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:13.569866    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:13.569894 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:13.569875    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:17.569856841 +0000 UTC m=+226.799929656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : configmap "kube-rbac-proxy" not found
Jul 01 18:10:13.570090 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:13.569916    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:17.569905764 +0000 UTC m=+226.799978590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:13.824366 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:13.824331    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:13.824545 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:13.824402    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:13.824773 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:13.824761    2567 scope.go:117] "RemoveContainer" containerID="17623dfcf65d6cdb0b66165ebac1ff289b526703d2cb79130cf5735e53ce83c7"
Jul 01 18:10:13.824928 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:13.824910    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-4f67x_openshift-console-operator(007fc588-afb3-4c42-b282-e1204664a892)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" podUID="007fc588-afb3-4c42-b282-e1204664a892"
Jul 01 18:10:14.115452 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:14.115359    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss" event={"ID":"84c84457-7593-452a-803e-066ec73f854d","Type":"ContainerStarted","Data":"0985241d1ea5ce72cfe938723208763dc02e7156aba5d3021361b4031151d67d"}
Jul 01 18:10:14.130875 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:14.130823    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-k55ss" podStartSLOduration=1.035783945 podStartE2EDuration="3.13080897s" totalImagesPullingTime="2.095025025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:14.129705198 +0000 UTC m=+223.359778032" watchObservedRunningTime="2026-07-01 18:10:14.13080897 +0000 UTC m=+223.360881853"
Jul 01 18:10:15.498670 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:15.498616    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:15.606488 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:15.606451    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:15.708069 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:15.708032    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:15.809269 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:15.809215    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:15.909350 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:15.909307    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:16.028635 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:16.028604    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:16.585921 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:16.585881    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:17.405581 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:17.405551    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:17.600655 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:17.600610    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:17.601658 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:17.601642    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:17.601723 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:17.601689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:17.601803 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:17.601791    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 01 18:10:17.601857 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:17.601809    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:17.601857 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:17.601839    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:25.60182564 +0000 UTC m=+234.831898452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : configmap "kube-rbac-proxy" not found
Jul 01 18:10:17.601947 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:17.601877    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls podName:b5ef3552-54c2-4c01-91e5-bd8ad74a0503 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:25.60185847 +0000 UTC m=+234.831931282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzwm7" (UID: "b5ef3552-54c2-4c01-91e5-bd8ad74a0503") : secret "insights-runtime-extractor-tls" not found
Jul 01 18:10:17.796343 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:17.796310    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:18.011648 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:18.011613    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:18.204839 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:18.204751    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:19.086717 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:19.086687    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:19.315439 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:19.315397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:19.317694 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:19.317671    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") pod \"image-registry-7847598fbb-mpv64\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") " pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:19.393379 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:19.393304    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:19.428708 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:19.428676    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:19.555923 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:19.555794    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7847598fbb-mpv64"]
Jul 01 18:10:19.558761 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:19.558729    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb406b9b2_ce5b_4547_ade5_ebd7ef3ecea1.slice/crio-3bbefe4836b7bee70ebaf84a9819fbd869a9c60a5f6f4954d1f95b6dd39e30a5 WatchSource:0}: Error finding container 3bbefe4836b7bee70ebaf84a9819fbd869a9c60a5f6f4954d1f95b6dd39e30a5: Status 404 returned error can't find the container with id 3bbefe4836b7bee70ebaf84a9819fbd869a9c60a5f6f4954d1f95b6dd39e30a5
Jul 01 18:10:20.135572 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:20.135539    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7847598fbb-mpv64" event={"ID":"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1","Type":"ContainerStarted","Data":"12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77"}
Jul 01 18:10:20.136030 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:20.135588    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7847598fbb-mpv64" event={"ID":"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1","Type":"ContainerStarted","Data":"3bbefe4836b7bee70ebaf84a9819fbd869a9c60a5f6f4954d1f95b6dd39e30a5"}
Jul 01 18:10:20.136030 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:20.135666    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:20.156298 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:20.156234    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7847598fbb-mpv64" podStartSLOduration=17.156217902 podStartE2EDuration="17.156217902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:20.155414661 +0000 UTC m=+229.385487521" watchObservedRunningTime="2026-07-01 18:10:20.156217902 +0000 UTC m=+229.386290777"
Jul 01 18:10:21.114864 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:21.114833    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:21.215846 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:21.215818    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:21.687843 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:21.687815    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:21.793141 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:21.793103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:22.225370 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:22.225341    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:22.325394 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:22.325362    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:22.425468 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:22.425439    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:23.300478 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:23.300438    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:23.400790 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:23.400758    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:23.623648 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:23.623568    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:24.007524 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:24.007439    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:24.245446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:24.245412    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:24.421540 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:24.421511    2567 scope.go:117] "RemoveContainer" containerID="17623dfcf65d6cdb0b66165ebac1ff289b526703d2cb79130cf5735e53ce83c7"
Jul 01 18:10:24.602083 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:24.602053    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:25.076674 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.076644    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:25.152484 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.152457    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:10:25.152830 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.152818    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/1.log"
Jul 01 18:10:25.152877 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.152847    2567 generic.go:356] "Generic (PLEG): container finished" podID="007fc588-afb3-4c42-b282-e1204664a892" containerID="ad0ad2eafd95a69e14332c658fb8abe8cf14c6d8aeb10786156a76923a37cb82" exitCode=255
Jul 01 18:10:25.152917 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.152887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" event={"ID":"007fc588-afb3-4c42-b282-e1204664a892","Type":"ContainerDied","Data":"ad0ad2eafd95a69e14332c658fb8abe8cf14c6d8aeb10786156a76923a37cb82"}
Jul 01 18:10:25.152948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.152929    2567 scope.go:117] "RemoveContainer" containerID="17623dfcf65d6cdb0b66165ebac1ff289b526703d2cb79130cf5735e53ce83c7"
Jul 01 18:10:25.153293 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.153277    2567 scope.go:117] "RemoveContainer" containerID="ad0ad2eafd95a69e14332c658fb8abe8cf14c6d8aeb10786156a76923a37cb82"
Jul 01 18:10:25.153458 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:25.153441    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-4f67x_openshift-console-operator(007fc588-afb3-4c42-b282-e1204664a892)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" podUID="007fc588-afb3-4c42-b282-e1204664a892"
Jul 01 18:10:25.398793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.398709    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:25.669437 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.669343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:25.669437 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.669408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:25.669977 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.669955    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:25.671783 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.671762    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b5ef3552-54c2-4c01-91e5-bd8ad74a0503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzwm7\" (UID: \"b5ef3552-54c2-4c01-91e5-bd8ad74a0503\") " pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:25.755079 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.755046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nzwm7"
Jul 01 18:10:25.790198 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.790168    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:25.884603 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:25.884574    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nzwm7"]
Jul 01 18:10:25.887717 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:25.887690    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ef3552_54c2_4c01_91e5_bd8ad74a0503.slice/crio-c02867935be267109315fb6e2dca231068378a6f77fc26bc7aba9279864dd59a WatchSource:0}: Error finding container c02867935be267109315fb6e2dca231068378a6f77fc26bc7aba9279864dd59a: Status 404 returned error can't find the container with id c02867935be267109315fb6e2dca231068378a6f77fc26bc7aba9279864dd59a
Jul 01 18:10:26.111795 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:26.111771    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:26.158034 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:26.158009    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:10:26.159186 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:26.159163    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzwm7" event={"ID":"b5ef3552-54c2-4c01-91e5-bd8ad74a0503","Type":"ContainerStarted","Data":"c02867935be267109315fb6e2dca231068378a6f77fc26bc7aba9279864dd59a"}
Jul 01 18:10:26.213207 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:26.213181    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:29.839139 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:29.839097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:29.940279 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:29.940228    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:30.177572 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:30.177480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzwm7" event={"ID":"b5ef3552-54c2-4c01-91e5-bd8ad74a0503","Type":"ContainerStarted","Data":"b918845fda892c3b887b194256800f23947f7f5707e39d7c5e98622f6c7f1789"}
Jul 01 18:10:31.182578 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:31.182502    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzwm7" event={"ID":"b5ef3552-54c2-4c01-91e5-bd8ad74a0503","Type":"ContainerStarted","Data":"93be8cc9821fd0f75c14d945d5dfa3e98506b8b614d03406c4ca79ff4dc7814b"}
Jul 01 18:10:32.802900 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.802865    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7847598fbb-mpv64"]
Jul 01 18:10:32.844080 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.844049    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"]
Jul 01 18:10:32.848805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.848781    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:32.863031 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.863008    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"]
Jul 01 18:10:32.881866 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.881828    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:32.923998 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.923959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f8fc377-e916-4921-b08f-5ecb467d5f6d-image-registry-private-configuration\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:32.924144 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.924010    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f8fc377-e916-4921-b08f-5ecb467d5f6d-bound-sa-token\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:32.924144 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.924041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f8fc377-e916-4921-b08f-5ecb467d5f6d-registry-certificates\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:32.924144 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.924105    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f8fc377-e916-4921-b08f-5ecb467d5f6d-trusted-ca\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:32.924371 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.924169    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f8fc377-e916-4921-b08f-5ecb467d5f6d-registry-tls\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:32.924371 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.924279    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f8fc377-e916-4921-b08f-5ecb467d5f6d-ca-trust-extracted\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:32.924371 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.924301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bshc\" (UniqueName: \"kubernetes.io/projected/4f8fc377-e916-4921-b08f-5ecb467d5f6d-kube-api-access-2bshc\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:32.924371 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.924333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f8fc377-e916-4921-b08f-5ecb467d5f6d-installation-pull-secrets\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:32.973774 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:32.973739    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:33.025022 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.024988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f8fc377-e916-4921-b08f-5ecb467d5f6d-installation-pull-secrets\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.025182 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.025036    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f8fc377-e916-4921-b08f-5ecb467d5f6d-image-registry-private-configuration\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.025182 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.025069    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f8fc377-e916-4921-b08f-5ecb467d5f6d-bound-sa-token\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.025182 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.025096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f8fc377-e916-4921-b08f-5ecb467d5f6d-registry-certificates\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.025182 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.025127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f8fc377-e916-4921-b08f-5ecb467d5f6d-trusted-ca\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.025182 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.025156    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f8fc377-e916-4921-b08f-5ecb467d5f6d-registry-tls\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.025460 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.025440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f8fc377-e916-4921-b08f-5ecb467d5f6d-ca-trust-extracted\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.025524 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.025477    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bshc\" (UniqueName: \"kubernetes.io/projected/4f8fc377-e916-4921-b08f-5ecb467d5f6d-kube-api-access-2bshc\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.025907 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.025854    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f8fc377-e916-4921-b08f-5ecb467d5f6d-ca-trust-extracted\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.026273 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.026250    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f8fc377-e916-4921-b08f-5ecb467d5f6d-trusted-ca\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.026453 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.026425    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f8fc377-e916-4921-b08f-5ecb467d5f6d-registry-certificates\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.027773 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.027749    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f8fc377-e916-4921-b08f-5ecb467d5f6d-image-registry-private-configuration\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.027857 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.027807    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f8fc377-e916-4921-b08f-5ecb467d5f6d-installation-pull-secrets\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.028176 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.028156    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f8fc377-e916-4921-b08f-5ecb467d5f6d-registry-tls\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.036709 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.036689    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f8fc377-e916-4921-b08f-5ecb467d5f6d-bound-sa-token\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.037076 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.037057    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bshc\" (UniqueName: \"kubernetes.io/projected/4f8fc377-e916-4921-b08f-5ecb467d5f6d-kube-api-access-2bshc\") pod \"image-registry-5c5fd87dc5-n9rqm\" (UID: \"4f8fc377-e916-4921-b08f-5ecb467d5f6d\") " pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.158871 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.158796    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:33.823642 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.823616    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:33.824056 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.824040    2567 scope.go:117] "RemoveContainer" containerID="ad0ad2eafd95a69e14332c658fb8abe8cf14c6d8aeb10786156a76923a37cb82"
Jul 01 18:10:33.824268 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.824227    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:33.824268 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:33.824253    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-4f67x_openshift-console-operator(007fc588-afb3-4c42-b282-e1204664a892)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" podUID="007fc588-afb3-4c42-b282-e1204664a892"
Jul 01 18:10:33.870521 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:33.870496    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"]
Jul 01 18:10:33.872733 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:33.872708    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8fc377_e916_4921_b08f_5ecb467d5f6d.slice/crio-246bb495f245eb0b705feec67395eaf50cff695b254261e5e6de60c3bcc572b8 WatchSource:0}: Error finding container 246bb495f245eb0b705feec67395eaf50cff695b254261e5e6de60c3bcc572b8: Status 404 returned error can't find the container with id 246bb495f245eb0b705feec67395eaf50cff695b254261e5e6de60c3bcc572b8
Jul 01 18:10:34.185386 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:34.185356    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:34.199507 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:34.199471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzwm7" event={"ID":"b5ef3552-54c2-4c01-91e5-bd8ad74a0503","Type":"ContainerStarted","Data":"2a295504cb56971123b98d6c267e86a2a8419eb9f3981f7972b846d70563691d"}
Jul 01 18:10:34.200945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:34.200914    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" event={"ID":"4f8fc377-e916-4921-b08f-5ecb467d5f6d","Type":"ContainerStarted","Data":"5f8fd55c5b51cfab766513eea1cbc45b664ba608c32806bd73ca22759a6dc51e"}
Jul 01 18:10:34.201039 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:34.200965    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" event={"ID":"4f8fc377-e916-4921-b08f-5ecb467d5f6d","Type":"ContainerStarted","Data":"246bb495f245eb0b705feec67395eaf50cff695b254261e5e6de60c3bcc572b8"}
Jul 01 18:10:34.201142 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:34.201124    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:10:34.201194 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:34.201180    2567 scope.go:117] "RemoveContainer" containerID="ad0ad2eafd95a69e14332c658fb8abe8cf14c6d8aeb10786156a76923a37cb82"
Jul 01 18:10:34.201335 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:34.201319    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-4f67x_openshift-console-operator(007fc588-afb3-4c42-b282-e1204664a892)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" podUID="007fc588-afb3-4c42-b282-e1204664a892"
Jul 01 18:10:34.218222 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:34.218185    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nzwm7" podStartSLOduration=17.427053041 podStartE2EDuration="25.218170984s" totalImagesPullingTime="7.791117943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:10:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:34.216654844 +0000 UTC m=+243.446727679" watchObservedRunningTime="2026-07-01 18:10:34.218170984 +0000 UTC m=+243.448243817"
Jul 01 18:10:34.234731 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:34.234666    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" podStartSLOduration=2.234653867 podStartE2EDuration="2.234653867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:34.233352764 +0000 UTC m=+243.463425598" watchObservedRunningTime="2026-07-01 18:10:34.234653867 +0000 UTC m=+243.464726700"
Jul 01 18:10:34.314364 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:34.314334    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:38.324131 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:38.324097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:38.424431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:38.424397    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:38.513687 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:38.513658    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:38.584269 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:38.584160    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:41.523052 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:41.523019    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:41.866880 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:41.866853    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:41.925285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:41.925251    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:42.808033 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:42.807994    2567 patch_prober.go:28] interesting pod/image-registry-7847598fbb-mpv64 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:10:42.808417 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:42.808048    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7847598fbb-mpv64" podUID="b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:10:43.204758 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:43.204666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:10:43.206982 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:43.206960    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb-metrics-certs\") pod \"network-metrics-daemon-ccl99\" (UID: \"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb\") " pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:10:43.224335 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:43.224314    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bhlcl\""
Jul 01 18:10:43.232280 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:43.232264    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccl99"
Jul 01 18:10:43.353978 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:43.353807    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ccl99"]
Jul 01 18:10:43.356338 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:43.356314    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3c45c1_f13f_43b5_a2d0_20a89c37c9cb.slice/crio-22adbe17af999c8c66c7358f2e51f3d04c2d828cb22e3a91825b23e416e6e67c WatchSource:0}: Error finding container 22adbe17af999c8c66c7358f2e51f3d04c2d828cb22e3a91825b23e416e6e67c: Status 404 returned error can't find the container with id 22adbe17af999c8c66c7358f2e51f3d04c2d828cb22e3a91825b23e416e6e67c
Jul 01 18:10:44.235827 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:44.235798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ccl99" event={"ID":"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb","Type":"ContainerStarted","Data":"22adbe17af999c8c66c7358f2e51f3d04c2d828cb22e3a91825b23e416e6e67c"}
Jul 01 18:10:44.952879 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:44.952827    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:45.244477 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:45.244382    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ccl99" event={"ID":"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb","Type":"ContainerStarted","Data":"eeb310c3a689339c3ff1eb759e231dc707cca764be60dd31ee44e8cf77baae60"}
Jul 01 18:10:45.244477 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:45.244470    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ccl99" event={"ID":"bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb","Type":"ContainerStarted","Data":"e31b11d6fe5553f303253642fa4dca042915c891aef30dbc270c357bbd47b9e9"}
Jul 01 18:10:45.259948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:45.259900    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ccl99" podStartSLOduration=253.385052176 podStartE2EDuration="4m14.259885892s" totalImagesPullingTime="874.833716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:45.259681166 +0000 UTC m=+254.489754033" watchObservedRunningTime="2026-07-01 18:10:45.259885892 +0000 UTC m=+254.489958725"
Jul 01 18:10:45.344825 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:45.344798    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:45.403544 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:45.403516    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:46.221143 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.221109    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:46.322194 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.322161    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:46.653478 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.653445    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:46.888389 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.888351    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:46.928858 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.928771    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ssnpd"]
Jul 01 18:10:46.931283 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.931263    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:46.934161 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.933906    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 01 18:10:46.934161 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.934030    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-js6g5\""
Jul 01 18:10:46.934161 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.934037    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 01 18:10:46.934987 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.934965    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 01 18:10:46.935094 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.935066    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 01 18:10:46.935184 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.934968    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 01 18:10:46.935824 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.935804    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 01 18:10:46.972701 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:46.972670    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:47.034482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.034445    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.034482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.034480    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6666bc99-8078-4c9d-a07a-7d86a47b04f2-root\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.034682 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.034503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6666bc99-8078-4c9d-a07a-7d86a47b04f2-sys\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.034682 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.034523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-tls\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.034682 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.034610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6666bc99-8078-4c9d-a07a-7d86a47b04f2-metrics-client-ca\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.034682 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.034644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v8x2\" (UniqueName: \"kubernetes.io/projected/6666bc99-8078-4c9d-a07a-7d86a47b04f2-kube-api-access-9v8x2\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.034682 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.034680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-wtmp\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.034850 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.034704    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.034850 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.034727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-textfile\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.049725 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.049698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:47.135287 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135250    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135287 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6666bc99-8078-4c9d-a07a-7d86a47b04f2-root\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135519 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135325    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6666bc99-8078-4c9d-a07a-7d86a47b04f2-sys\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135519 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135349    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-tls\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135519 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6666bc99-8078-4c9d-a07a-7d86a47b04f2-metrics-client-ca\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135519 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135410    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v8x2\" (UniqueName: \"kubernetes.io/projected/6666bc99-8078-4c9d-a07a-7d86a47b04f2-kube-api-access-9v8x2\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135519 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135421    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6666bc99-8078-4c9d-a07a-7d86a47b04f2-root\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135519 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135447    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-wtmp\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135519 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135477    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135519 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-textfile\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.135903 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.135653    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6666bc99-8078-4c9d-a07a-7d86a47b04f2-sys\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.136219 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.136198    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-textfile\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.136359 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.136336    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-accelerators-collector-config\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.136440 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.136361    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6666bc99-8078-4c9d-a07a-7d86a47b04f2-metrics-client-ca\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.136440 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.136205    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-wtmp\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.138131 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.138094    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-tls\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.138222 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.138156    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6666bc99-8078-4c9d-a07a-7d86a47b04f2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.143204 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.143166    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v8x2\" (UniqueName: \"kubernetes.io/projected/6666bc99-8078-4c9d-a07a-7d86a47b04f2-kube-api-access-9v8x2\") pod \"node-exporter-ssnpd\" (UID: \"6666bc99-8078-4c9d-a07a-7d86a47b04f2\") " pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.150109 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.150082    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:47.242465 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.242378    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ssnpd"
Jul 01 18:10:47.552088 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.552061    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:47.604958 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.604931    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:47.878649 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.878570    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:47.973214 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.973180    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:47.982626 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.982597    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 18:10:47.987110 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.987092    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:47.989842 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.989818    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 01 18:10:47.990001 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.989851    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 01 18:10:47.990001 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.989865    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 01 18:10:47.990001 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.989942    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 01 18:10:47.990219 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.990199    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 01 18:10:47.990348 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.990274    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 01 18:10:47.990348 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.990284    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2tmtd\""
Jul 01 18:10:47.990511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.990492    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 01 18:10:47.990511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.990503    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 01 18:10:47.990658 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:47.990563    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 01 18:10:48.003026 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.003001    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 18:10:48.098933 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.098898    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:48.144886 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.144811    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.144886 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.144850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.144886 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.144869    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145108 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.144928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-web-config\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145108 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.144974    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145108 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.144998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpcd8\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-kube-api-access-qpcd8\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145108 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.145027    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145108 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.145095    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145385 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.145130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145385 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.145177    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145385 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.145228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145385 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.145296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-out\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.145385 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.145329    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246314 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246278    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246503 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246503 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246503 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246362    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246503 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-web-config\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246711 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246711 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpcd8\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-kube-api-access-qpcd8\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246711 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246573    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246711 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246711 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246633    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246711 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246669    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246991 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.246991 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.246752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-out\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.247386 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.247354    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.247833 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.247801    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.248107 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.248079    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.249354 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.249332    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-web-config\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.249489 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.249398    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.249692 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.249662    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.249812 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.249788    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.250167 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.250140    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-out\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.250476 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.250458    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.250572 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.250552    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.251275 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.251233    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.251329 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.251295    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.254560 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.254541    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpcd8\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-kube-api-access-qpcd8\") pod \"alertmanager-main-0\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.256146 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.256123    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ssnpd" event={"ID":"6666bc99-8078-4c9d-a07a-7d86a47b04f2","Type":"ContainerStarted","Data":"8b3563445c862aa3c74c8f868533607b34525ea142b801d88a1341126b7aff12"}
Jul 01 18:10:48.296651 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.296628    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:10:48.422096 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.421992    2567 scope.go:117] "RemoveContainer" containerID="ad0ad2eafd95a69e14332c658fb8abe8cf14c6d8aeb10786156a76923a37cb82"
Jul 01 18:10:48.438743 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:48.438658    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 18:10:48.455323 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:48.455294    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b224e49_50e6_4c5d_a3d6_cc837042dc2c.slice/crio-5f6442180edcd9947c44df4acd3678ca94798cd6f89465d4eca342ae1bac1a20 WatchSource:0}: Error finding container 5f6442180edcd9947c44df4acd3678ca94798cd6f89465d4eca342ae1bac1a20: Status 404 returned error can't find the container with id 5f6442180edcd9947c44df4acd3678ca94798cd6f89465d4eca342ae1bac1a20
Jul 01 18:10:49.260552 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.260471    2567 generic.go:356] "Generic (PLEG): container finished" podID="6666bc99-8078-4c9d-a07a-7d86a47b04f2" containerID="f1f2122b68985072d004174d6c4e3dfbd5ea99316ab787e482d6fa8c7c9f2b5d" exitCode=0
Jul 01 18:10:49.260945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.260559    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ssnpd" event={"ID":"6666bc99-8078-4c9d-a07a-7d86a47b04f2","Type":"ContainerDied","Data":"f1f2122b68985072d004174d6c4e3dfbd5ea99316ab787e482d6fa8c7c9f2b5d"}
Jul 01 18:10:49.261779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.261758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerStarted","Data":"5f6442180edcd9947c44df4acd3678ca94798cd6f89465d4eca342ae1bac1a20"}
Jul 01 18:10:49.263577 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.263559    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:10:49.263667 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.263609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" event={"ID":"007fc588-afb3-4c42-b282-e1204664a892","Type":"ContainerStarted","Data":"11755c33a7a03007a0d7b246c15bd5223600bdcc1d39e80835a4aafc6c668bb9"}
Jul 01 18:10:49.263849 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.263831    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:49.268871 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.268849    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x"
Jul 01 18:10:49.277222 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.277192    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-6z6tc"]
Jul 01 18:10:49.285066 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.285043    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-6z6tc"
Jul 01 18:10:49.288316 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.288292    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 01 18:10:49.288420 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.288374    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 01 18:10:49.288473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.288425    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6jps9\""
Jul 01 18:10:49.292446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.292421    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-6z6tc"]
Jul 01 18:10:49.295799 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.295772    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:49.332303 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.332226    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-4f67x" podStartSLOduration=42.153960573 podStartE2EDuration="46.332209309s" totalImagesPullingTime="4.178248736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:49.331532208 +0000 UTC m=+258.561605043" watchObservedRunningTime="2026-07-01 18:10:49.332209309 +0000 UTC m=+258.562282142"
Jul 01 18:10:49.391039 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.391017    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:49.458182 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.458149    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72tl\" (UniqueName: \"kubernetes.io/projected/3626e7d7-094b-401e-b782-3f81c75981cd-kube-api-access-j72tl\") pod \"downloads-5499b6fb8f-6z6tc\" (UID: \"3626e7d7-094b-401e-b782-3f81c75981cd\") " pod="openshift-console/downloads-5499b6fb8f-6z6tc"
Jul 01 18:10:49.559441 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.559403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j72tl\" (UniqueName: \"kubernetes.io/projected/3626e7d7-094b-401e-b782-3f81c75981cd-kube-api-access-j72tl\") pod \"downloads-5499b6fb8f-6z6tc\" (UID: \"3626e7d7-094b-401e-b782-3f81c75981cd\") " pod="openshift-console/downloads-5499b6fb8f-6z6tc"
Jul 01 18:10:49.568206 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.568175    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72tl\" (UniqueName: \"kubernetes.io/projected/3626e7d7-094b-401e-b782-3f81c75981cd-kube-api-access-j72tl\") pod \"downloads-5499b6fb8f-6z6tc\" (UID: \"3626e7d7-094b-401e-b782-3f81c75981cd\") " pod="openshift-console/downloads-5499b6fb8f-6z6tc"
Jul 01 18:10:49.568392 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.568369    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:49.619479 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.619444    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-6z6tc"
Jul 01 18:10:49.621179 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.621156    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:49.767413 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.767376    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-6z6tc"]
Jul 01 18:10:49.770497 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:49.770470    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3626e7d7_094b_401e_b782_3f81c75981cd.slice/crio-984aec0f28cd5c3f326613921dd901bccf50a0a9db62574267e77d3d5c8b786e WatchSource:0}: Error finding container 984aec0f28cd5c3f326613921dd901bccf50a0a9db62574267e77d3d5c8b786e: Status 404 returned error can't find the container with id 984aec0f28cd5c3f326613921dd901bccf50a0a9db62574267e77d3d5c8b786e
Jul 01 18:10:49.889771 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.889679    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:49.951211 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:49.951172    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:50.014118 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.014072    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:50.239145 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.239041    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:50.269689 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.269653    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ssnpd" event={"ID":"6666bc99-8078-4c9d-a07a-7d86a47b04f2","Type":"ContainerStarted","Data":"6a535b37e134ea33d5499eb94a152aa8b032c0cb12871b6640e1f7ddb48f7649"}
Jul 01 18:10:50.270121 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.269720    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ssnpd" event={"ID":"6666bc99-8078-4c9d-a07a-7d86a47b04f2","Type":"ContainerStarted","Data":"3a04c95b726e0938a81bef0399cbd2d99e5d1bec648fe5a5306ec3a95f817bcc"}
Jul 01 18:10:50.270805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.270786    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-6z6tc" event={"ID":"3626e7d7-094b-401e-b782-3f81c75981cd","Type":"ContainerStarted","Data":"984aec0f28cd5c3f326613921dd901bccf50a0a9db62574267e77d3d5c8b786e"}
Jul 01 18:10:50.291279 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.291208    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ssnpd" podStartSLOduration=2.644472345 podStartE2EDuration="4.29118627s" totalImagesPullingTime="1.584639762s" totalInitContainerRuntime="62.074163ms" isStatefulPod=true podCreationTimestamp="2026-07-01 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:50.28866287 +0000 UTC m=+259.518735707" watchObservedRunningTime="2026-07-01 18:10:50.29118627 +0000 UTC m=+259.521259104"
Jul 01 18:10:50.303149 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.303113    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:50.414232 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.414207    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:50.514030 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.513955    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:50.694585 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.694545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:50.769778 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.769665    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:50.960985 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:50.960940    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:51.210970 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.207428    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-577f5d66d7-jm5nk"]
Jul 01 18:10:51.212474 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.212444    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.216367 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.216343    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9nq9cvqgvda8e\""
Jul 01 18:10:51.216477 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.216378    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 01 18:10:51.216477 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.216343    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 01 18:10:51.216477 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.216344    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 01 18:10:51.216784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.216561    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 01 18:10:51.216784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.216655    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tcpdr\""
Jul 01 18:10:51.221094 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.221071    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-577f5d66d7-jm5nk"]
Jul 01 18:10:51.274161 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.274129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c0f4fe70-afb6-45b8-9908-da23eec74e2a-secret-metrics-server-tls\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.274161 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.274165    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f4fe70-afb6-45b8-9908-da23eec74e2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.274600 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.274209    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f4fe70-afb6-45b8-9908-da23eec74e2a-client-ca-bundle\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.274600 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.274228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f29t4\" (UniqueName: \"kubernetes.io/projected/c0f4fe70-afb6-45b8-9908-da23eec74e2a-kube-api-access-f29t4\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.274600 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.274259    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c0f4fe70-afb6-45b8-9908-da23eec74e2a-secret-metrics-server-client-certs\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.274600 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.274288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c0f4fe70-afb6-45b8-9908-da23eec74e2a-metrics-server-audit-profiles\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.274600 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.274340    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c0f4fe70-afb6-45b8-9908-da23eec74e2a-audit-log\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.276163 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.276139    2567 generic.go:356] "Generic (PLEG): container finished" podID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerID="d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d" exitCode=0
Jul 01 18:10:51.276300 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.276221    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerDied","Data":"d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d"}
Jul 01 18:10:51.375945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.375913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f4fe70-afb6-45b8-9908-da23eec74e2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.376137 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.376053    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f4fe70-afb6-45b8-9908-da23eec74e2a-client-ca-bundle\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.376137 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.376117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29t4\" (UniqueName: \"kubernetes.io/projected/c0f4fe70-afb6-45b8-9908-da23eec74e2a-kube-api-access-f29t4\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.376279 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.376168    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c0f4fe70-afb6-45b8-9908-da23eec74e2a-secret-metrics-server-client-certs\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.376346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.376311    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c0f4fe70-afb6-45b8-9908-da23eec74e2a-metrics-server-audit-profiles\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.376532 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.376507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c0f4fe70-afb6-45b8-9908-da23eec74e2a-audit-log\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.376651 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.376632    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c0f4fe70-afb6-45b8-9908-da23eec74e2a-secret-metrics-server-tls\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.376740 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.376726    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0f4fe70-afb6-45b8-9908-da23eec74e2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.377508 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.377473    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c0f4fe70-afb6-45b8-9908-da23eec74e2a-audit-log\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.377692 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.377672    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c0f4fe70-afb6-45b8-9908-da23eec74e2a-metrics-server-audit-profiles\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.379639 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.379617    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0f4fe70-afb6-45b8-9908-da23eec74e2a-client-ca-bundle\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.379744 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.379688    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c0f4fe70-afb6-45b8-9908-da23eec74e2a-secret-metrics-server-client-certs\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.379818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.379790    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c0f4fe70-afb6-45b8-9908-da23eec74e2a-secret-metrics-server-tls\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.385074 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.385050    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f29t4\" (UniqueName: \"kubernetes.io/projected/c0f4fe70-afb6-45b8-9908-da23eec74e2a-kube-api-access-f29t4\") pod \"metrics-server-577f5d66d7-jm5nk\" (UID: \"c0f4fe70-afb6-45b8-9908-da23eec74e2a\") " pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.522352 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.522265    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:10:51.659668 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.659640    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-577f5d66d7-jm5nk"]
Jul 01 18:10:51.662663 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:51.662631    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f4fe70_afb6_45b8_9908_da23eec74e2a.slice/crio-0a7c07b4d599804ed8ef7b73c7875bd203be5fca583c3f320253bf5804ed8443 WatchSource:0}: Error finding container 0a7c07b4d599804ed8ef7b73c7875bd203be5fca583c3f320253bf5804ed8443: Status 404 returned error can't find the container with id 0a7c07b4d599804ed8ef7b73c7875bd203be5fca583c3f320253bf5804ed8443
Jul 01 18:10:51.682609 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.682586    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"]
Jul 01 18:10:51.687076 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.687059    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:51.689601 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.689575    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 01 18:10:51.689713 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.689608    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6zmb4\""
Jul 01 18:10:51.693410 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.693386    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"]
Jul 01 18:10:51.779529 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.779494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9qm\" (UniqueName: \"kubernetes.io/projected/e0f954d4-23af-43f9-bf7e-c008c7654407-kube-api-access-6l9qm\") pod \"monitoring-plugin-cd8656b8-c28jf\" (UID: \"e0f954d4-23af-43f9-bf7e-c008c7654407\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:51.779708 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.779613    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0f954d4-23af-43f9-bf7e-c008c7654407-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-c28jf\" (UID: \"e0f954d4-23af-43f9-bf7e-c008c7654407\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:51.827404 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.827367    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:51.880564 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.880523    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9qm\" (UniqueName: \"kubernetes.io/projected/e0f954d4-23af-43f9-bf7e-c008c7654407-kube-api-access-6l9qm\") pod \"monitoring-plugin-cd8656b8-c28jf\" (UID: \"e0f954d4-23af-43f9-bf7e-c008c7654407\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:51.880761 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.880605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0f954d4-23af-43f9-bf7e-c008c7654407-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-c28jf\" (UID: \"e0f954d4-23af-43f9-bf7e-c008c7654407\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:51.882994 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.882969    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0f954d4-23af-43f9-bf7e-c008c7654407-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-c28jf\" (UID: \"e0f954d4-23af-43f9-bf7e-c008c7654407\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:51.886396 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.886373    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:51.888159 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.888141    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9qm\" (UniqueName: \"kubernetes.io/projected/e0f954d4-23af-43f9-bf7e-c008c7654407-kube-api-access-6l9qm\") pod \"monitoring-plugin-cd8656b8-c28jf\" (UID: \"e0f954d4-23af-43f9-bf7e-c008c7654407\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:51.999260 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:51.999220    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:52.128299 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.128270    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"]
Jul 01 18:10:52.131443 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:52.131403    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f954d4_23af_43f9_bf7e_c008c7654407.slice/crio-c8ab5ed7f030fc4538909c17b2d1d812c478af274578c6d6fed27bb9356ddc84 WatchSource:0}: Error finding container c8ab5ed7f030fc4538909c17b2d1d812c478af274578c6d6fed27bb9356ddc84: Status 404 returned error can't find the container with id c8ab5ed7f030fc4538909c17b2d1d812c478af274578c6d6fed27bb9356ddc84
Jul 01 18:10:52.282414 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.282374    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf" event={"ID":"e0f954d4-23af-43f9-bf7e-c008c7654407","Type":"ContainerStarted","Data":"c8ab5ed7f030fc4538909c17b2d1d812c478af274578c6d6fed27bb9356ddc84"}
Jul 01 18:10:52.288077 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.285224    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk" event={"ID":"c0f4fe70-afb6-45b8-9908-da23eec74e2a","Type":"ContainerStarted","Data":"0a7c07b4d599804ed8ef7b73c7875bd203be5fca583c3f320253bf5804ed8443"}
Jul 01 18:10:52.388190 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.388107    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b8d46d9bf-sh6br"]
Jul 01 18:10:52.391835 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.391809    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.394529 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.394506    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 01 18:10:52.395646 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.395624    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-t2zfl\""
Jul 01 18:10:52.395751 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.395624    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 01 18:10:52.395844 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.395828    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 01 18:10:52.395925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.395911    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 01 18:10:52.395985 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.395945    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 01 18:10:52.400937 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.400225    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8d46d9bf-sh6br"]
Jul 01 18:10:52.485381 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.485344    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j4fg\" (UniqueName: \"kubernetes.io/projected/5faa583d-b3d5-444a-a5d3-60016486845d-kube-api-access-8j4fg\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.485561 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.485421    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-serving-cert\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.485561 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.485461    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-service-ca\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.485561 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.485499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-oauth-serving-cert\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.485561 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.485548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-oauth-config\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.485789 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.485576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-console-config\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.586131 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.586094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j4fg\" (UniqueName: \"kubernetes.io/projected/5faa583d-b3d5-444a-a5d3-60016486845d-kube-api-access-8j4fg\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.586357 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.586195    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-serving-cert\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.586357 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.586269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-service-ca\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.586357 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.586309    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-oauth-serving-cert\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.586357 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.586337    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-oauth-config\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.586590 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.586366    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-console-config\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.587403 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.587374    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-console-config\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.587815 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.587788    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-oauth-serving-cert\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.587901 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.587807    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-service-ca\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.589510 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.589460    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-oauth-config\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.590059 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.590028    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-serving-cert\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.594676 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.594651    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j4fg\" (UniqueName: \"kubernetes.io/projected/5faa583d-b3d5-444a-a5d3-60016486845d-kube-api-access-8j4fg\") pod \"console-b8d46d9bf-sh6br\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") " pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.703441 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.703358    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:10:52.810591 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.810549    2567 patch_prober.go:28] interesting pod/image-registry-7847598fbb-mpv64 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:10:52.810744 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.810623    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7847598fbb-mpv64" podUID="b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:10:52.876853 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:52.876676    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8d46d9bf-sh6br"]
Jul 01 18:10:53.126747 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:53.126691    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:53.166285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:53.166231    2567 patch_prober.go:28] interesting pod/image-registry-5c5fd87dc5-n9rqm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:10:53.166461 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:53.166311    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" podUID="4f8fc377-e916-4921-b08f-5ecb467d5f6d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:10:53.322630 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:10:53.322593    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5faa583d_b3d5_444a_a5d3_60016486845d.slice/crio-8fed65563db4a647d8127fe028b6e7f476c19636ccdf51dc0dfcabeb9c508a83 WatchSource:0}: Error finding container 8fed65563db4a647d8127fe028b6e7f476c19636ccdf51dc0dfcabeb9c508a83: Status 404 returned error can't find the container with id 8fed65563db4a647d8127fe028b6e7f476c19636ccdf51dc0dfcabeb9c508a83
Jul 01 18:10:54.296350 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:54.296277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk" event={"ID":"c0f4fe70-afb6-45b8-9908-da23eec74e2a","Type":"ContainerStarted","Data":"af739fb4322830820c33881b1bd1bd30c32b222d7624b98262d010f3372673b2"}
Jul 01 18:10:54.298185 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:54.298129    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8d46d9bf-sh6br" event={"ID":"5faa583d-b3d5-444a-a5d3-60016486845d","Type":"ContainerStarted","Data":"8fed65563db4a647d8127fe028b6e7f476c19636ccdf51dc0dfcabeb9c508a83"}
Jul 01 18:10:54.318360 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:54.318155    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk" podStartSLOduration=1.615472176 podStartE2EDuration="3.318133493s" totalImagesPullingTime="1.702661317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:54.316643073 +0000 UTC m=+263.546715909" watchObservedRunningTime="2026-07-01 18:10:54.318133493 +0000 UTC m=+263.548206328"
Jul 01 18:10:55.209544 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:55.209506    2567 patch_prober.go:28] interesting pod/image-registry-5c5fd87dc5-n9rqm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:10:55.210010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:55.209562    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" podUID="4f8fc377-e916-4921-b08f-5ecb467d5f6d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:10:55.307615 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:55.307578    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerStarted","Data":"39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a"}
Jul 01 18:10:55.307805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:55.307697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerStarted","Data":"7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311"}
Jul 01 18:10:55.307805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:55.307739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerStarted","Data":"b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64"}
Jul 01 18:10:55.307805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:55.307774    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerStarted","Data":"4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e"}
Jul 01 18:10:55.308057 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:55.307808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerStarted","Data":"db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438"}
Jul 01 18:10:55.309888 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:55.309443    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf" event={"ID":"e0f954d4-23af-43f9-bf7e-c008c7654407","Type":"ContainerStarted","Data":"134920a853703428fd3d5d5488e16c47a8755dec5aa9308e3838ab45e4a749f3"}
Jul 01 18:10:55.326361 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:55.326300    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf" podStartSLOduration=2.167274981 podStartE2EDuration="4.326278102s" totalImagesPullingTime="2.159003121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:55.324870191 +0000 UTC m=+264.554943027" watchObservedRunningTime="2026-07-01 18:10:55.326278102 +0000 UTC m=+264.556350938"
Jul 01 18:10:56.315375 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:56.315301    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:56.321960 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:56.321753    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-c28jf"
Jul 01 18:10:57.825123 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:57.825080    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7847598fbb-mpv64" podUID="b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" containerName="registry" containerID="cri-o://12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77" gracePeriod=30
Jul 01 18:10:58.084358 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.084299    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:58.149368 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.149331    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-trusted-ca\") pod \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") "
Jul 01 18:10:58.149525 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.149387    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpnjh\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-kube-api-access-bpnjh\") pod \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") "
Jul 01 18:10:58.149525 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.149450    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-certificates\") pod \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") "
Jul 01 18:10:58.149525 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.149480    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-bound-sa-token\") pod \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") "
Jul 01 18:10:58.149525 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.149504    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-installation-pull-secrets\") pod \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") "
Jul 01 18:10:58.149725 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.149538    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") pod \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") "
Jul 01 18:10:58.149725 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.149598    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-image-registry-private-configuration\") pod \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") "
Jul 01 18:10:58.149725 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.149632    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-ca-trust-extracted\") pod \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\" (UID: \"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1\") "
Jul 01 18:10:58.149859 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.149836    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:10:58.150260 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.150170    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:10:58.152507 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.152462    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:10:58.152784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.152679    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:10:58.152784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.152756    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-kube-api-access-bpnjh" (OuterVolumeSpecName: "kube-api-access-bpnjh") pod "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1"). InnerVolumeSpecName "kube-api-access-bpnjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:10:58.152949 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.152928    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:10:58.153800 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.153773    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:10:58.160439 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.160416    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" (UID: "b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:10:58.250738 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.250702    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-installation-pull-secrets\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:10:58.250738 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.250730    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:10:58.250738 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.250740    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-image-registry-private-configuration\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:10:58.250948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.250749    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-ca-trust-extracted\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:10:58.250948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.250758    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-trusted-ca\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:10:58.250948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.250766    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpnjh\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-kube-api-access-bpnjh\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:10:58.250948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.250773    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-registry-certificates\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:10:58.250948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.250781    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1-bound-sa-token\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:10:58.327266 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.327209    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerStarted","Data":"378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3"}
Jul 01 18:10:58.328419 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.328393    2567 generic.go:356] "Generic (PLEG): container finished" podID="b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" containerID="12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77" exitCode=0
Jul 01 18:10:58.328568 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.328446    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7847598fbb-mpv64"
Jul 01 18:10:58.328568 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.328465    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7847598fbb-mpv64" event={"ID":"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1","Type":"ContainerDied","Data":"12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77"}
Jul 01 18:10:58.328568 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.328504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7847598fbb-mpv64" event={"ID":"b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1","Type":"ContainerDied","Data":"3bbefe4836b7bee70ebaf84a9819fbd869a9c60a5f6f4954d1f95b6dd39e30a5"}
Jul 01 18:10:58.328568 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.328526    2567 scope.go:117] "RemoveContainer" containerID="12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77"
Jul 01 18:10:58.330143 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.330116    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8d46d9bf-sh6br" event={"ID":"5faa583d-b3d5-444a-a5d3-60016486845d","Type":"ContainerStarted","Data":"25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3"}
Jul 01 18:10:58.343736 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.343719    2567 scope.go:117] "RemoveContainer" containerID="12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77"
Jul 01 18:10:58.343994 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:10:58.343970    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77\": container with ID starting with 12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77 not found: ID does not exist" containerID="12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77"
Jul 01 18:10:58.344103 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.343999    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77"} err="failed to get container status \"12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77\": rpc error: code = NotFound desc = could not find container \"12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77\": container with ID starting with 12867d9d8ffd10a515d6bdc70e358baa4a22ae74e77836167f1f6e3370768f77 not found: ID does not exist"
Jul 01 18:10:58.357159 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.357113    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.730210395 podStartE2EDuration="11.35710114s" totalImagesPullingTime="7.608236951s" totalInitContainerRuntime="18.653794ms" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:58.355824886 +0000 UTC m=+267.585897744" watchObservedRunningTime="2026-07-01 18:10:58.35710114 +0000 UTC m=+267.587173973"
Jul 01 18:10:58.372838 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.372787    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b8d46d9bf-sh6br" podStartSLOduration=2.246661618 podStartE2EDuration="6.372768998s" totalImagesPullingTime="4.12610738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:58.371993481 +0000 UTC m=+267.602066319" watchObservedRunningTime="2026-07-01 18:10:58.372768998 +0000 UTC m=+267.602841833"
Jul 01 18:10:58.385423 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.385398    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7847598fbb-mpv64"]
Jul 01 18:10:58.390476 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:58.390455    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7847598fbb-mpv64"]
Jul 01 18:10:59.427970 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:59.427935    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" path="/var/lib/kubelet/pods/b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1/volumes"
Jul 01 18:10:59.839162 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:59.839123    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:10:59.939700 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:10:59.939664    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:02.181337 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.181287    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c44686ddd-dcq9s"]
Jul 01 18:11:02.181908 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.181889    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" containerName="registry"
Jul 01 18:11:02.182004 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.181911    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" containerName="registry"
Jul 01 18:11:02.182109 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.182097    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b406b9b2-ce5b-4547-ade5-ebd7ef3ecea1" containerName="registry"
Jul 01 18:11:02.192377 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.192353    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.194948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.194922    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c44686ddd-dcq9s"]
Jul 01 18:11:02.200817 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.200615    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 01 18:11:02.287818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.287782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-oauth-serving-cert\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.287818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.287826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffx4j\" (UniqueName: \"kubernetes.io/projected/5e7a0d9f-2332-4780-87a2-4da66ae32875-kube-api-access-ffx4j\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.288064 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.287954    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-service-ca\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.288064 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.287990    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-oauth-config\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.288064 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.288034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-trusted-ca-bundle\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.288201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.288103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-config\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.288201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.288170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-serving-cert\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.388897 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.388869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-serving-cert\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.389070 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.388906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-oauth-serving-cert\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.389070 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.388942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffx4j\" (UniqueName: \"kubernetes.io/projected/5e7a0d9f-2332-4780-87a2-4da66ae32875-kube-api-access-ffx4j\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.389070 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.388988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-service-ca\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.389070 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.389006    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-oauth-config\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.389070 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.389021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-trusted-ca-bundle\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.389070 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.389043    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-config\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.389817 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.389791    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-config\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.390168 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.390122    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-service-ca\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.390288 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.390171    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-oauth-serving-cert\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.390367 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.390305    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-trusted-ca-bundle\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.392134 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.392100    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-oauth-config\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.392314 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.392292    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-serving-cert\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.397540 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.397521    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffx4j\" (UniqueName: \"kubernetes.io/projected/5e7a0d9f-2332-4780-87a2-4da66ae32875-kube-api-access-ffx4j\") pod \"console-5c44686ddd-dcq9s\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") " pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.504863 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.504782    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:02.704613 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.704575    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:11:02.704793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.704634    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:11:02.706020 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.705996    2567 patch_prober.go:28] interesting pod/console-b8d46d9bf-sh6br container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body=
Jul 01 18:11:02.706119 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:02.706047    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b8d46d9bf-sh6br" podUID="5faa583d-b3d5-444a-a5d3-60016486845d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused"
Jul 01 18:11:03.140517 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:03.140483    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:03.164421 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:03.164374    2567 patch_prober.go:28] interesting pod/image-registry-5c5fd87dc5-n9rqm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:11:03.164583 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:03.164450    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" podUID="4f8fc377-e916-4921-b08f-5ecb467d5f6d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:11:03.378740 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:03.378712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:03.478971 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:03.478887    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:05.208705 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:05.208671    2567 patch_prober.go:28] interesting pod/image-registry-5c5fd87dc5-n9rqm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:11:05.209187 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:05.208721    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" podUID="4f8fc377-e916-4921-b08f-5ecb467d5f6d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:11:06.046923 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:06.046890    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:06.101065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:06.101033    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:06.780355 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:06.780305    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:06.837418 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:06.837368    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:07.114825 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:07.114755    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:07.169295 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:07.169255    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:09.540452 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:09.540417    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c44686ddd-dcq9s"]
Jul 01 18:11:09.542984 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:11:09.542953    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7a0d9f_2332_4780_87a2_4da66ae32875.slice/crio-a6fa18c7f59b99f333daf77a6a5573561ece60ea8366ea35eb0b5877cc8ecd56 WatchSource:0}: Error finding container a6fa18c7f59b99f333daf77a6a5573561ece60ea8366ea35eb0b5877cc8ecd56: Status 404 returned error can't find the container with id a6fa18c7f59b99f333daf77a6a5573561ece60ea8366ea35eb0b5877cc8ecd56
Jul 01 18:11:10.383527 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:10.383429    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-6z6tc" event={"ID":"3626e7d7-094b-401e-b782-3f81c75981cd","Type":"ContainerStarted","Data":"c33982fb442084f53dc6f91adca5fc8a2b22cbce9fb05828e653f76e6ceefb5a"}
Jul 01 18:11:10.383527 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:10.383504    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-6z6tc"
Jul 01 18:11:10.385564 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:10.385184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c44686ddd-dcq9s" event={"ID":"5e7a0d9f-2332-4780-87a2-4da66ae32875","Type":"ContainerStarted","Data":"1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5"}
Jul 01 18:11:10.385564 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:10.385230    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c44686ddd-dcq9s" event={"ID":"5e7a0d9f-2332-4780-87a2-4da66ae32875","Type":"ContainerStarted","Data":"a6fa18c7f59b99f333daf77a6a5573561ece60ea8366ea35eb0b5877cc8ecd56"}
Jul 01 18:11:10.396376 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:10.396351    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-6z6tc"
Jul 01 18:11:10.402711 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:10.402663    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-6z6tc" podStartSLOduration=1.6969214 podStartE2EDuration="21.402647681s" totalImagesPullingTime="19.705726281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:11:10.400689227 +0000 UTC m=+279.630762063" watchObservedRunningTime="2026-07-01 18:11:10.402647681 +0000 UTC m=+279.632720546"
Jul 01 18:11:10.418839 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:10.418778    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c44686ddd-dcq9s" podStartSLOduration=8.41876377 podStartE2EDuration="8.41876377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:11:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:11:10.417179095 +0000 UTC m=+279.647251930" watchObservedRunningTime="2026-07-01 18:11:10.41876377 +0000 UTC m=+279.648836605"
Jul 01 18:11:11.523214 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:11.523172    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:11:11.523704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:11.523266    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:11:11.988371 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:11.988340    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:12.054062 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:12.054031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:12.505126 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:12.505092    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:12.505338 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:12.505194    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:12.506636 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:12.506606    2567 patch_prober.go:28] interesting pod/console-5c44686ddd-dcq9s container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body=
Jul 01 18:11:12.506761 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:12.506660    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c44686ddd-dcq9s" podUID="5e7a0d9f-2332-4780-87a2-4da66ae32875" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused"
Jul 01 18:11:12.704931 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:12.704890    2567 patch_prober.go:28] interesting pod/console-b8d46d9bf-sh6br container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body=
Jul 01 18:11:12.705345 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:12.704958    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b8d46d9bf-sh6br" podUID="5faa583d-b3d5-444a-a5d3-60016486845d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused"
Jul 01 18:11:12.927725 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:11:12.927681    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cwwp4" podUID="6f70f713-2706-4b59-ba5d-6969e783e7ab"
Jul 01 18:11:13.164194 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:13.164162    2567 patch_prober.go:28] interesting pod/image-registry-5c5fd87dc5-n9rqm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:11:13.164382 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:13.164216    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" podUID="4f8fc377-e916-4921-b08f-5ecb467d5f6d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:11:13.164382 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:13.164278    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:11:13.164873 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:13.164845    2567 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"5f8fd55c5b51cfab766513eea1cbc45b664ba608c32806bd73ca22759a6dc51e"} pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 01 18:11:13.168952 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:13.168920    2567 patch_prober.go:28] interesting pod/image-registry-5c5fd87dc5-n9rqm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:11:13.169075 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:13.168986    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" podUID="4f8fc377-e916-4921-b08f-5ecb467d5f6d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:11:13.404650 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:13.404610    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:11:16.511482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:16.511452    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:16.530721 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:16.530686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:11:16.533434 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:16.533404    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f70f713-2706-4b59-ba5d-6969e783e7ab-metrics-tls\") pod \"dns-default-cwwp4\" (UID: \"6f70f713-2706-4b59-ba5d-6969e783e7ab\") " pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:11:16.569907 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:16.569864    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:16.708252 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:16.708221    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vsbfc\""
Jul 01 18:11:16.716528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:16.716496    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:11:16.885967 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:16.885938    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cwwp4"]
Jul 01 18:11:16.889193 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:11:16.889160    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f70f713_2706_4b59_ba5d_6969e783e7ab.slice/crio-ddc1aabc752c5b05103c2661bf28ed653974baf6e17628c40cc3fafb1f6bab3b WatchSource:0}: Error finding container ddc1aabc752c5b05103c2661bf28ed653974baf6e17628c40cc3fafb1f6bab3b: Status 404 returned error can't find the container with id ddc1aabc752c5b05103c2661bf28ed653974baf6e17628c40cc3fafb1f6bab3b
Jul 01 18:11:17.426940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:17.426902    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cwwp4" event={"ID":"6f70f713-2706-4b59-ba5d-6969e783e7ab","Type":"ContainerStarted","Data":"ddc1aabc752c5b05103c2661bf28ed653974baf6e17628c40cc3fafb1f6bab3b"}
Jul 01 18:11:19.432918 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:19.432881    2567 generic.go:356] "Generic (PLEG): container finished" podID="1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09" containerID="75bdd61e061106e97100602c2a4a0bf64002b22b752471dcd2caf4e0735c5dad" exitCode=0
Jul 01 18:11:19.433323 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:19.432966    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-pcmfc" event={"ID":"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09","Type":"ContainerDied","Data":"75bdd61e061106e97100602c2a4a0bf64002b22b752471dcd2caf4e0735c5dad"}
Jul 01 18:11:19.433461 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:19.433442    2567 scope.go:117] "RemoveContainer" containerID="75bdd61e061106e97100602c2a4a0bf64002b22b752471dcd2caf4e0735c5dad"
Jul 01 18:11:20.439129 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:20.439093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-pcmfc" event={"ID":"1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09","Type":"ContainerStarted","Data":"bdc900af80710c731173fb134b23a77e7490c38492c6ca27c065b75bbafd5eb7"}
Jul 01 18:11:20.440836 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:20.440814    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cwwp4" event={"ID":"6f70f713-2706-4b59-ba5d-6969e783e7ab","Type":"ContainerStarted","Data":"48a153a53aa48d91a43ea6075bd77b51550794e5d6bccdd8b56ee07b6a907bdf"}
Jul 01 18:11:20.440964 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:20.440853    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cwwp4" event={"ID":"6f70f713-2706-4b59-ba5d-6969e783e7ab","Type":"ContainerStarted","Data":"cd273b0a212049c59fe64f08362331d19f426614de84168eeac05962a6c11aab"}
Jul 01 18:11:20.440964 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:20.440876    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:11:20.442281 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:20.442260    2567 generic.go:356] "Generic (PLEG): container finished" podID="dba92742-325f-4d75-9e60-aa6550511df1" containerID="b5bba43a55d78ee8469c2949aafb3229e7aeee4f7b4904e235fa3266476b1855" exitCode=0
Jul 01 18:11:20.442401 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:20.442290    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn" event={"ID":"dba92742-325f-4d75-9e60-aa6550511df1","Type":"ContainerDied","Data":"b5bba43a55d78ee8469c2949aafb3229e7aeee4f7b4904e235fa3266476b1855"}
Jul 01 18:11:20.442522 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:20.442508    2567 scope.go:117] "RemoveContainer" containerID="b5bba43a55d78ee8469c2949aafb3229e7aeee4f7b4904e235fa3266476b1855"
Jul 01 18:11:20.473998 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:20.473910    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cwwp4" podStartSLOduration=251.403582594 podStartE2EDuration="4m14.473889988s" totalImagesPullingTime="3.070307394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:11:20.473147113 +0000 UTC m=+289.703219961" watchObservedRunningTime="2026-07-01 18:11:20.473889988 +0000 UTC m=+289.703962822"
Jul 01 18:11:21.447184 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:21.447144    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-wrcrn" event={"ID":"dba92742-325f-4d75-9e60-aa6550511df1","Type":"ContainerStarted","Data":"eef79cc468e498518bbc73d242d3a3caef0928744b745f23097c6c2e78dd6431"}
Jul 01 18:11:22.425410 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:22.425374    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b224e49-50e6-4c5d-a3d6-cc837042dc2c/init-config-reloader/0.log"
Jul 01 18:11:22.509998 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:22.509967    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:22.513933 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:22.513911    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:11:22.579588 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:22.579558    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8d46d9bf-sh6br"]
Jul 01 18:11:22.625710 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:22.625652    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b224e49-50e6-4c5d-a3d6-cc837042dc2c/alertmanager/0.log"
Jul 01 18:11:22.711267 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:22.711181    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:22.812696 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:22.812665    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:22.826255 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:22.826213    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b224e49-50e6-4c5d-a3d6-cc837042dc2c/config-reloader/0.log"
Jul 01 18:11:22.911839 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:22.911807    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:23.028610 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:23.028581    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b224e49-50e6-4c5d-a3d6-cc837042dc2c/kube-rbac-proxy-web/0.log"
Jul 01 18:11:23.030484 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:23.030463    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:23.133907 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:23.133860    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:23.169315 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:23.169288    2567 patch_prober.go:28] interesting pod/image-registry-5c5fd87dc5-n9rqm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 01 18:11:23.169475 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:23.169338    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" podUID="4f8fc377-e916-4921-b08f-5ecb467d5f6d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:11:23.226310 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:23.226287    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b224e49-50e6-4c5d-a3d6-cc837042dc2c/kube-rbac-proxy/0.log"
Jul 01 18:11:23.433817 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:23.433744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b224e49-50e6-4c5d-a3d6-cc837042dc2c/kube-rbac-proxy-metric/0.log"
Jul 01 18:11:23.625860 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:23.625830    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b224e49-50e6-4c5d-a3d6-cc837042dc2c/prom-label-proxy/0.log"
Jul 01 18:11:24.625994 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:24.625960    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-577f5d66d7-jm5nk_c0f4fe70-afb6-45b8-9908-da23eec74e2a/metrics-server/0.log"
Jul 01 18:11:24.826364 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:24.826335    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-c28jf_e0f954d4-23af-43f9-bf7e-c008c7654407/monitoring-plugin/0.log"
Jul 01 18:11:25.359546 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:25.359514    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:26.074353 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:26.074319    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:26.126441 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:26.126389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:26.225102 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:26.225077    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ssnpd_6666bc99-8078-4c9d-a07a-7d86a47b04f2/init-textfile/0.log"
Jul 01 18:11:26.427291 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:26.427203    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ssnpd_6666bc99-8078-4c9d-a07a-7d86a47b04f2/node-exporter/0.log"
Jul 01 18:11:26.625233 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:26.625202    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ssnpd_6666bc99-8078-4c9d-a07a-7d86a47b04f2/kube-rbac-proxy/0.log"
Jul 01 18:11:26.945677 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:26.945646    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:26.999392 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:26.999364    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:29.839277 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:29.839221    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:29.940297 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:29.940264    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:30.449816 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:30.449790    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cwwp4"
Jul 01 18:11:30.825452 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:30.825425    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:11:31.027076 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.027045    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/3.log"
Jul 01 18:11:31.225174 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.225104    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c44686ddd-dcq9s_5e7a0d9f-2332-4780-87a2-4da66ae32875/console/0.log"
Jul 01 18:11:31.340007 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.339915    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:11:31.340323 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.340306    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:11:31.350110 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.350085    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:11:31.350500 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.350476    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:11:31.354698 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.354683    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 01 18:11:31.426347 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.426323    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b8d46d9bf-sh6br_5faa583d-b3d5-444a-a5d3-60016486845d/console/0.log"
Jul 01 18:11:31.528562 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.528541    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:11:31.645284 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.532702    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-577f5d66d7-jm5nk"
Jul 01 18:11:31.645284 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:31.626260    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-6z6tc_3626e7d7-094b-401e-b782-3f81c75981cd/download-server/0.log"
Jul 01 18:11:32.226551 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:32.226527    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cwwp4_6f70f713-2706-4b59-ba5d-6969e783e7ab/dns/0.log"
Jul 01 18:11:32.430590 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:32.430562    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cwwp4_6f70f713-2706-4b59-ba5d-6969e783e7ab/kube-rbac-proxy/0.log"
Jul 01 18:11:33.168799 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:33.168765    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:11:33.228608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:33.228585    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gq6w6_c1d599f9-956d-4ac5-81c3-c1b9351e30a8/dns-node-resolver/0.log"
Jul 01 18:11:33.304960 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:33.304927    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:33.405712 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:33.405686    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:33.511629 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:33.511549    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:33.613821 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:33.613788    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:33.825530 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:33.825503    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c5fd87dc5-n9rqm_4f8fc377-e916-4921-b08f-5ecb467d5f6d/registry/0.log"
Jul 01 18:11:34.025115 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:34.025087    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-28ftw_cd95642d-fd67-4914-8f8e-2a1b1efd9e99/node-ca/0.log"
Jul 01 18:11:34.485041 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:34.485007    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:34.550023 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:34.549988    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:34.824914 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:34.824885    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9wd2p_0a4a5924-1af3-4547-ac01-f9b9c2261553/serve-healthcheck-canary/0.log"
Jul 01 18:11:35.964479 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:35.964451    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:36.064893 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:36.064866    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:38.188908 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:38.188754    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" podUID="4f8fc377-e916-4921-b08f-5ecb467d5f6d" containerName="registry" containerID="cri-o://5f8fd55c5b51cfab766513eea1cbc45b664ba608c32806bd73ca22759a6dc51e" gracePeriod=30
Jul 01 18:11:39.521298 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:39.521265    2567 generic.go:356] "Generic (PLEG): container finished" podID="4f8fc377-e916-4921-b08f-5ecb467d5f6d" containerID="5f8fd55c5b51cfab766513eea1cbc45b664ba608c32806bd73ca22759a6dc51e" exitCode=0
Jul 01 18:11:39.521654 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:39.521335    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" event={"ID":"4f8fc377-e916-4921-b08f-5ecb467d5f6d","Type":"ContainerDied","Data":"5f8fd55c5b51cfab766513eea1cbc45b664ba608c32806bd73ca22759a6dc51e"}
Jul 01 18:11:40.527104 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:40.527070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm" event={"ID":"4f8fc377-e916-4921-b08f-5ecb467d5f6d","Type":"ContainerStarted","Data":"e91c8122f95918147a2026ffb5c43ad3dd64f5dd7fd38a7e4b703c5653236ef1"}
Jul 01 18:11:40.527512 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:40.527194    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:11:40.796898 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:40.796874    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:40.897920 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:40.897882    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:44.843738 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:44.843708    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:44.943333 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:44.943299    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:45.044229 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:45.044199    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:47.600284 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.600211    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b8d46d9bf-sh6br" podUID="5faa583d-b3d5-444a-a5d3-60016486845d" containerName="console" containerID="cri-o://25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3" gracePeriod=15
Jul 01 18:11:47.865961 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.865893    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:11:47.995454 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.995419    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-serving-cert\") pod \"5faa583d-b3d5-444a-a5d3-60016486845d\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") "
Jul 01 18:11:47.995624 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.995469    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j4fg\" (UniqueName: \"kubernetes.io/projected/5faa583d-b3d5-444a-a5d3-60016486845d-kube-api-access-8j4fg\") pod \"5faa583d-b3d5-444a-a5d3-60016486845d\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") "
Jul 01 18:11:47.995624 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.995492    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-oauth-serving-cert\") pod \"5faa583d-b3d5-444a-a5d3-60016486845d\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") "
Jul 01 18:11:47.995624 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.995511    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-console-config\") pod \"5faa583d-b3d5-444a-a5d3-60016486845d\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") "
Jul 01 18:11:47.995771 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.995679    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-service-ca\") pod \"5faa583d-b3d5-444a-a5d3-60016486845d\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") "
Jul 01 18:11:47.995771 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.995725    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-oauth-config\") pod \"5faa583d-b3d5-444a-a5d3-60016486845d\" (UID: \"5faa583d-b3d5-444a-a5d3-60016486845d\") "
Jul 01 18:11:47.995879 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.995851    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-console-config" (OuterVolumeSpecName: "console-config") pod "5faa583d-b3d5-444a-a5d3-60016486845d" (UID: "5faa583d-b3d5-444a-a5d3-60016486845d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:11:47.996022 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.995996    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5faa583d-b3d5-444a-a5d3-60016486845d" (UID: "5faa583d-b3d5-444a-a5d3-60016486845d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:11:47.996085 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.996031    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-service-ca" (OuterVolumeSpecName: "service-ca") pod "5faa583d-b3d5-444a-a5d3-60016486845d" (UID: "5faa583d-b3d5-444a-a5d3-60016486845d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:11:47.996161 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.996148    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-oauth-serving-cert\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:11:47.996213 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.996162    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-console-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:11:47.996213 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.996172    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5faa583d-b3d5-444a-a5d3-60016486845d-service-ca\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:11:47.997756 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.997730    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5faa583d-b3d5-444a-a5d3-60016486845d" (UID: "5faa583d-b3d5-444a-a5d3-60016486845d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:11:47.997848 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.997756    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5faa583d-b3d5-444a-a5d3-60016486845d" (UID: "5faa583d-b3d5-444a-a5d3-60016486845d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:11:47.997848 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:47.997769    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5faa583d-b3d5-444a-a5d3-60016486845d-kube-api-access-8j4fg" (OuterVolumeSpecName: "kube-api-access-8j4fg") pod "5faa583d-b3d5-444a-a5d3-60016486845d" (UID: "5faa583d-b3d5-444a-a5d3-60016486845d"). InnerVolumeSpecName "kube-api-access-8j4fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:11:48.097274 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.097228    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j4fg\" (UniqueName: \"kubernetes.io/projected/5faa583d-b3d5-444a-a5d3-60016486845d-kube-api-access-8j4fg\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:11:48.097274 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.097272    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-oauth-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:11:48.097274 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.097282    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5faa583d-b3d5-444a-a5d3-60016486845d-console-serving-cert\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:11:48.558711 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.558673    2567 generic.go:356] "Generic (PLEG): container finished" podID="5faa583d-b3d5-444a-a5d3-60016486845d" containerID="25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3" exitCode=0
Jul 01 18:11:48.558881 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.558744    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8d46d9bf-sh6br"
Jul 01 18:11:48.558881 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.558748    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8d46d9bf-sh6br" event={"ID":"5faa583d-b3d5-444a-a5d3-60016486845d","Type":"ContainerDied","Data":"25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3"}
Jul 01 18:11:48.558881 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.558798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8d46d9bf-sh6br" event={"ID":"5faa583d-b3d5-444a-a5d3-60016486845d","Type":"ContainerDied","Data":"8fed65563db4a647d8127fe028b6e7f476c19636ccdf51dc0dfcabeb9c508a83"}
Jul 01 18:11:48.558881 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.558824    2567 scope.go:117] "RemoveContainer" containerID="25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3"
Jul 01 18:11:48.567292 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.567271    2567 scope.go:117] "RemoveContainer" containerID="25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3"
Jul 01 18:11:48.567567 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:11:48.567546    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3\": container with ID starting with 25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3 not found: ID does not exist" containerID="25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3"
Jul 01 18:11:48.567631 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.567576    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3"} err="failed to get container status \"25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3\": rpc error: code = NotFound desc = could not find container \"25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3\": container with ID starting with 25560b649cb4352f5d771cde9903ac887be5f71d4c9390e53f13ba5b511b4ed3 not found: ID does not exist"
Jul 01 18:11:48.579112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.579082    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8d46d9bf-sh6br"]
Jul 01 18:11:48.582567 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:48.582542    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b8d46d9bf-sh6br"]
Jul 01 18:11:49.426739 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:49.426707    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5faa583d-b3d5-444a-a5d3-60016486845d" path="/var/lib/kubelet/pods/5faa583d-b3d5-444a-a5d3-60016486845d/volumes"
Jul 01 18:11:52.612560 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:52.612525    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:52.714777 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:52.714744    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:59.846831 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:59.846792    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:11:59.944391 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:11:59.944361    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:01.536262 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:01.536209    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c5fd87dc5-n9rqm"
Jul 01 18:12:01.796645 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:01.796556    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:02.471951 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:02.471919    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:06.123808 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:06.123771    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:06.527489 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:06.527463    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:07.183945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.183910    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 18:12:07.184397 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.184201    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="alertmanager" containerID="cri-o://db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438" gracePeriod=120
Jul 01 18:12:07.184397 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.184277    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy-metric" containerID="cri-o://39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a" gracePeriod=120
Jul 01 18:12:07.184397 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.184311    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy-web" containerID="cri-o://b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64" gracePeriod=120
Jul 01 18:12:07.184397 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.184359    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy" containerID="cri-o://7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311" gracePeriod=120
Jul 01 18:12:07.184397 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.184346    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="prom-label-proxy" containerID="cri-o://378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3" gracePeriod=120
Jul 01 18:12:07.184634 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.184410    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="config-reloader" containerID="cri-o://4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e" gracePeriod=120
Jul 01 18:12:07.636626 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.636590    2567 generic.go:356] "Generic (PLEG): container finished" podID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerID="378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3" exitCode=0
Jul 01 18:12:07.636626 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.636620    2567 generic.go:356] "Generic (PLEG): container finished" podID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerID="7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311" exitCode=0
Jul 01 18:12:07.636626 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.636628    2567 generic.go:356] "Generic (PLEG): container finished" podID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerID="4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e" exitCode=0
Jul 01 18:12:07.636626 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.636634    2567 generic.go:356] "Generic (PLEG): container finished" podID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerID="db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438" exitCode=0
Jul 01 18:12:07.636945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.636669    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerDied","Data":"378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3"}
Jul 01 18:12:07.636945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.636746    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerDied","Data":"7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311"}
Jul 01 18:12:07.636945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.636784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerDied","Data":"4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e"}
Jul 01 18:12:07.636945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:07.636820    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerDied","Data":"db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438"}
Jul 01 18:12:08.428270 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.428233    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.575521 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.575485    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-out\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.575521 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.575529    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpcd8\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-kube-api-access-qpcd8\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.575770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.575548    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-main-tls\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.575770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.575566    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-trusted-ca-bundle\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.575770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.575594    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-metrics-client-ca\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.575770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.575638    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-web-config\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.575770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.575661    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-tls-assets\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.575770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.575695    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-main-db\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.576055 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.575950    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:08.576055 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576024    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-volume\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.576055 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576030    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:12:08.576223 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576062    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-cluster-tls-config\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.576223 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576065    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:08.576223 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576131    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.576223 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576172    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.576223 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576204    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\" (UID: \"7b224e49-50e6-4c5d-a3d6-cc837042dc2c\") "
Jul 01 18:12:08.576641 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576618    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.576718 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576645    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-metrics-client-ca\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.576718 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.576659    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-alertmanager-main-db\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.578589 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.578475    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-volume" (OuterVolumeSpecName: "config-volume") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:08.578715 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.578590    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:12:08.578715 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.578651    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-out" (OuterVolumeSpecName: "config-out") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:12:08.579198 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.578896    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:08.579198 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.578905    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-kube-api-access-qpcd8" (OuterVolumeSpecName: "kube-api-access-qpcd8") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "kube-api-access-qpcd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:12:08.580195 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.580172    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:08.580594 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.580563    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:08.580776 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.580757    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:08.583497 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.583367    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:08.590433 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.590393    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-web-config" (OuterVolumeSpecName: "web-config") pod "7b224e49-50e6-4c5d-a3d6-cc837042dc2c" (UID: "7b224e49-50e6-4c5d-a3d6-cc837042dc2c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:08.644032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.643993    2567 generic.go:356] "Generic (PLEG): container finished" podID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerID="39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a" exitCode=0
Jul 01 18:12:08.644032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.644023    2567 generic.go:356] "Generic (PLEG): container finished" podID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerID="b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64" exitCode=0
Jul 01 18:12:08.644257 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.644051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerDied","Data":"39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a"}
Jul 01 18:12:08.644257 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.644074    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.644257 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.644105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerDied","Data":"b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64"}
Jul 01 18:12:08.644257 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.644143    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b224e49-50e6-4c5d-a3d6-cc837042dc2c","Type":"ContainerDied","Data":"5f6442180edcd9947c44df4acd3678ca94798cd6f89465d4eca342ae1bac1a20"}
Jul 01 18:12:08.644257 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.644175    2567 scope.go:117] "RemoveContainer" containerID="378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3"
Jul 01 18:12:08.652413 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.652390    2567 scope.go:117] "RemoveContainer" containerID="39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a"
Jul 01 18:12:08.659819 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.659797    2567 scope.go:117] "RemoveContainer" containerID="7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311"
Jul 01 18:12:08.667533 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.667508    2567 scope.go:117] "RemoveContainer" containerID="b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64"
Jul 01 18:12:08.668590 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.668562    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 18:12:08.672006 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.671981    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 18:12:08.675841 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.675822    2567 scope.go:117] "RemoveContainer" containerID="4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e"
Jul 01 18:12:08.677085 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677067    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-out\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.677138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677090    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpcd8\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-kube-api-access-qpcd8\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.677138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677102    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-main-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.677138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677112    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-web-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.677138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677120    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-tls-assets\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.677138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677127    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-config-volume\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.677138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677134    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-cluster-tls-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.677335 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677147    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.677335 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677158    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.677335 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.677166    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b224e49-50e6-4c5d-a3d6-cc837042dc2c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:08.683755 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.683731    2567 scope.go:117] "RemoveContainer" containerID="db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438"
Jul 01 18:12:08.691887 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.691867    2567 scope.go:117] "RemoveContainer" containerID="d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d"
Jul 01 18:12:08.699589 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699558    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 18:12:08.699836 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699818    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="prom-label-proxy"
Jul 01 18:12:08.699836 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699833    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="prom-label-proxy"
Jul 01 18:12:08.699836 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699842    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy-web"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699849    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy-web"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699861    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="alertmanager"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699869    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="alertmanager"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699874    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699880    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699887    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="init-config-reloader"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699892    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="init-config-reloader"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699901    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5faa583d-b3d5-444a-a5d3-60016486845d" containerName="console"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699906    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5faa583d-b3d5-444a-a5d3-60016486845d" containerName="console"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699911    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="config-reloader"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699916    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="config-reloader"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699924    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy-metric"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699929    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy-metric"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699970    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5faa583d-b3d5-444a-a5d3-60016486845d" containerName="console"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699978    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="config-reloader"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699985    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy-metric"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699991    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="prom-label-proxy"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.699997    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy-web"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.700003    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="kube-rbac-proxy"
Jul 01 18:12:08.700010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.700009    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" containerName="alertmanager"
Jul 01 18:12:08.700787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.700055    2567 scope.go:117] "RemoveContainer" containerID="378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3"
Jul 01 18:12:08.700787 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:12:08.700417    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3\": container with ID starting with 378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3 not found: ID does not exist" containerID="378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3"
Jul 01 18:12:08.700787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.700445    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3"} err="failed to get container status \"378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3\": rpc error: code = NotFound desc = could not find container \"378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3\": container with ID starting with 378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3 not found: ID does not exist"
Jul 01 18:12:08.700787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.700462    2567 scope.go:117] "RemoveContainer" containerID="39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a"
Jul 01 18:12:08.700787 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:12:08.700683    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a\": container with ID starting with 39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a not found: ID does not exist" containerID="39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a"
Jul 01 18:12:08.700787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.700702    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a"} err="failed to get container status \"39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a\": rpc error: code = NotFound desc = could not find container \"39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a\": container with ID starting with 39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a not found: ID does not exist"
Jul 01 18:12:08.700787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.700713    2567 scope.go:117] "RemoveContainer" containerID="7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311"
Jul 01 18:12:08.701030 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:12:08.700941    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311\": container with ID starting with 7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311 not found: ID does not exist" containerID="7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311"
Jul 01 18:12:08.701030 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.700961    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311"} err="failed to get container status \"7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311\": rpc error: code = NotFound desc = could not find container \"7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311\": container with ID starting with 7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311 not found: ID does not exist"
Jul 01 18:12:08.701030 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.700977    2567 scope.go:117] "RemoveContainer" containerID="b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64"
Jul 01 18:12:08.701228 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:12:08.701214    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64\": container with ID starting with b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64 not found: ID does not exist" containerID="b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64"
Jul 01 18:12:08.701534 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.701230    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64"} err="failed to get container status \"b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64\": rpc error: code = NotFound desc = could not find container \"b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64\": container with ID starting with b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64 not found: ID does not exist"
Jul 01 18:12:08.701577 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.701537    2567 scope.go:117] "RemoveContainer" containerID="4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e"
Jul 01 18:12:08.701814 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:12:08.701794    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e\": container with ID starting with 4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e not found: ID does not exist" containerID="4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e"
Jul 01 18:12:08.701863 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.701819    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e"} err="failed to get container status \"4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e\": rpc error: code = NotFound desc = could not find container \"4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e\": container with ID starting with 4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e not found: ID does not exist"
Jul 01 18:12:08.701863 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.701836    2567 scope.go:117] "RemoveContainer" containerID="db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438"
Jul 01 18:12:08.702082 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:12:08.702066    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438\": container with ID starting with db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438 not found: ID does not exist" containerID="db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438"
Jul 01 18:12:08.702124 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.702085    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438"} err="failed to get container status \"db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438\": rpc error: code = NotFound desc = could not find container \"db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438\": container with ID starting with db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438 not found: ID does not exist"
Jul 01 18:12:08.702124 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.702097    2567 scope.go:117] "RemoveContainer" containerID="d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d"
Jul 01 18:12:08.702376 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:12:08.702354    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d\": container with ID starting with d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d not found: ID does not exist" containerID="d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d"
Jul 01 18:12:08.702491 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.702380    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d"} err="failed to get container status \"d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d\": rpc error: code = NotFound desc = could not find container \"d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d\": container with ID starting with d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d not found: ID does not exist"
Jul 01 18:12:08.702491 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.702400    2567 scope.go:117] "RemoveContainer" containerID="378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3"
Jul 01 18:12:08.702653 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.702635    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3"} err="failed to get container status \"378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3\": rpc error: code = NotFound desc = could not find container \"378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3\": container with ID starting with 378b9ef4de5c6008dae594c05351c15b3b46b9204876507ed9dff9be4b7b8fb3 not found: ID does not exist"
Jul 01 18:12:08.702704 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.702664    2567 scope.go:117] "RemoveContainer" containerID="39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a"
Jul 01 18:12:08.703009 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.702905    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a"} err="failed to get container status \"39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a\": rpc error: code = NotFound desc = could not find container \"39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a\": container with ID starting with 39e52b8c7cbcee3f7b5b3531c15d0f2f559fc529947d8ad40afc2eb39d4b067a not found: ID does not exist"
Jul 01 18:12:08.703009 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.702950    2567 scope.go:117] "RemoveContainer" containerID="7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311"
Jul 01 18:12:08.703446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.703425    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311"} err="failed to get container status \"7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311\": rpc error: code = NotFound desc = could not find container \"7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311\": container with ID starting with 7e653f9d3c0bfd6799179f525f68fdfcff88c96b7f86adef4eb3e4774495e311 not found: ID does not exist"
Jul 01 18:12:08.703536 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.703445    2567 scope.go:117] "RemoveContainer" containerID="b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64"
Jul 01 18:12:08.703717 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.703688    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64"} err="failed to get container status \"b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64\": rpc error: code = NotFound desc = could not find container \"b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64\": container with ID starting with b0106efae40abecbf9b2162b8dcff14fbbecebfe4d823d06ff3326bc236c4e64 not found: ID does not exist"
Jul 01 18:12:08.703717 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.703717    2567 scope.go:117] "RemoveContainer" containerID="4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e"
Jul 01 18:12:08.703990 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.703968    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e"} err="failed to get container status \"4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e\": rpc error: code = NotFound desc = could not find container \"4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e\": container with ID starting with 4ff39a881a1e6a8f34e6ad7e691c38baf301f4a76961f1fc7d7f0f3b7057e30e not found: ID does not exist"
Jul 01 18:12:08.704053 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.703991    2567 scope.go:117] "RemoveContainer" containerID="db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438"
Jul 01 18:12:08.704272 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.704230    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438"} err="failed to get container status \"db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438\": rpc error: code = NotFound desc = could not find container \"db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438\": container with ID starting with db384b5e1bc2aa3349a1f7ee3e23e97bf3c94e5a3195711760be88f9c3921438 not found: ID does not exist"
Jul 01 18:12:08.704272 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.704271    2567 scope.go:117] "RemoveContainer" containerID="d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d"
Jul 01 18:12:08.704440 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.704424    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.704501 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.704456    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d"} err="failed to get container status \"d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d\": rpc error: code = NotFound desc = could not find container \"d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d\": container with ID starting with d2a5e1f6f4730528e918d684bab072fce9ef2d0f3aead49f082f16e3f62d978d not found: ID does not exist"
Jul 01 18:12:08.712554 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.712531    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 01 18:12:08.712698 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.712663    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 01 18:12:08.712745 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.712663    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 01 18:12:08.712794 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.712777    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 01 18:12:08.712932 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.712915    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 01 18:12:08.712985 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.712958    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 01 18:12:08.712985 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.712960    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 01 18:12:08.713090 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.713072    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 01 18:12:08.713353 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.713335    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2tmtd\""
Jul 01 18:12:08.717213 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.717194    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 01 18:12:08.727456 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.727427    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 18:12:08.778099 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778099 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778121    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135f0700-d087-4871-8834-f07049fccf3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-web-config\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksqtf\" (UniqueName: \"kubernetes.io/projected/135f0700-d087-4871-8834-f07049fccf3f-kube-api-access-ksqtf\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/135f0700-d087-4871-8834-f07049fccf3f-config-out\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/135f0700-d087-4871-8834-f07049fccf3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778373    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778433    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778459    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/135f0700-d087-4871-8834-f07049fccf3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/135f0700-d087-4871-8834-f07049fccf3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.778553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.778509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879475 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879391    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135f0700-d087-4871-8834-f07049fccf3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879475 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-web-config\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879475 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879449    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksqtf\" (UniqueName: \"kubernetes.io/projected/135f0700-d087-4871-8834-f07049fccf3f-kube-api-access-ksqtf\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879475 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879477    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/135f0700-d087-4871-8834-f07049fccf3f-config-out\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/135f0700-d087-4871-8834-f07049fccf3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879604    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879628    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/135f0700-d087-4871-8834-f07049fccf3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879661    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/135f0700-d087-4871-8834-f07049fccf3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.879779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.879749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.880289 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.880061    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/135f0700-d087-4871-8834-f07049fccf3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.880530 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.880506    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/135f0700-d087-4871-8834-f07049fccf3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.880949 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.880922    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135f0700-d087-4871-8834-f07049fccf3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.882770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.882640    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-web-config\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.882770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.882640    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.882770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.882730    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.882958 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.882855    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/135f0700-d087-4871-8834-f07049fccf3f-config-out\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.883089 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.883068    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/135f0700-d087-4871-8834-f07049fccf3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.883128 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.883076    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.883209 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.883192    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.883432 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.883417    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.884342 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.884320    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/135f0700-d087-4871-8834-f07049fccf3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:08.887448 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:08.887428    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksqtf\" (UniqueName: \"kubernetes.io/projected/135f0700-d087-4871-8834-f07049fccf3f-kube-api-access-ksqtf\") pod \"alertmanager-main-0\" (UID: \"135f0700-d087-4871-8834-f07049fccf3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:09.013203 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:09.013162    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 18:12:09.166508 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:09.166431    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 18:12:09.169518 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:12:09.169494    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135f0700_d087_4871_8834_f07049fccf3f.slice/crio-f04e40fd01adc2138da2afd606dedf8e1dad84c74ba5f68ea42ae1ce11578f51 WatchSource:0}: Error finding container f04e40fd01adc2138da2afd606dedf8e1dad84c74ba5f68ea42ae1ce11578f51: Status 404 returned error can't find the container with id f04e40fd01adc2138da2afd606dedf8e1dad84c74ba5f68ea42ae1ce11578f51
Jul 01 18:12:09.432970 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:09.432878    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b224e49-50e6-4c5d-a3d6-cc837042dc2c" path="/var/lib/kubelet/pods/7b224e49-50e6-4c5d-a3d6-cc837042dc2c/volumes"
Jul 01 18:12:09.649265 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:09.649207    2567 generic.go:356] "Generic (PLEG): container finished" podID="135f0700-d087-4871-8834-f07049fccf3f" containerID="ef0fa7ccac47276898662f2127db2ae577a47aaad254b949590e138995a73b17" exitCode=0
Jul 01 18:12:09.649443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:09.649297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"135f0700-d087-4871-8834-f07049fccf3f","Type":"ContainerDied","Data":"ef0fa7ccac47276898662f2127db2ae577a47aaad254b949590e138995a73b17"}
Jul 01 18:12:09.649443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:09.649379    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"135f0700-d087-4871-8834-f07049fccf3f","Type":"ContainerStarted","Data":"f04e40fd01adc2138da2afd606dedf8e1dad84c74ba5f68ea42ae1ce11578f51"}
Jul 01 18:12:10.657611 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:10.657579    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"135f0700-d087-4871-8834-f07049fccf3f","Type":"ContainerStarted","Data":"02240fa98898cc73f4690e7f9cc8635fc08a23f58627130ac4629d5fceaab22a"}
Jul 01 18:12:10.657989 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:10.657649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"135f0700-d087-4871-8834-f07049fccf3f","Type":"ContainerStarted","Data":"ce0b6c68fc4c0e1e88bd404947029dc0940cc92d281d74663e8779772160f0c8"}
Jul 01 18:12:10.657989 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:10.657680    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"135f0700-d087-4871-8834-f07049fccf3f","Type":"ContainerStarted","Data":"655492a5cb4e8304c1dfd294f005397449cd5d43f706b26ca3b30469acf58c27"}
Jul 01 18:12:10.657989 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:10.657707    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"135f0700-d087-4871-8834-f07049fccf3f","Type":"ContainerStarted","Data":"9c32a7fc102f813f57cf7e477a3259c40103daf8d5e42c50e5a68ef290c4c966"}
Jul 01 18:12:10.657989 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:10.657740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"135f0700-d087-4871-8834-f07049fccf3f","Type":"ContainerStarted","Data":"ffb3c6098ed91e75461cce0892642f180d4ef52e5058ad3f3fcbd4fc3b1e29cb"}
Jul 01 18:12:10.657989 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:10.657766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"135f0700-d087-4871-8834-f07049fccf3f","Type":"ContainerStarted","Data":"30b345a16a6a6c379995d0524f390ab4d8b7be2e477ab94cc05f147873c1fe61"}
Jul 01 18:12:10.690212 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:10.690164    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.671057193 podStartE2EDuration="2.690147559s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.090366ms" isStatefulPod=false podCreationTimestamp="2026-07-01 18:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:12:10.688635095 +0000 UTC m=+339.918707928" watchObservedRunningTime="2026-07-01 18:12:10.690147559 +0000 UTC m=+339.920220393"
Jul 01 18:12:11.213972 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.213936    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d795b4686-ptg44"]
Jul 01 18:12:11.216539 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.216520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.218879 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.218855    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 01 18:12:11.219271 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.219229    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 01 18:12:11.219346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.219298    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 01 18:12:11.219399 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.219351    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 01 18:12:11.219613 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.219599    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 01 18:12:11.219728 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.219712    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mbdd8\""
Jul 01 18:12:11.224104 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.223694    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 01 18:12:11.232933 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.232903    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d795b4686-ptg44"]
Jul 01 18:12:11.305333 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.305298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjnkk\" (UniqueName: \"kubernetes.io/projected/21e22463-e2a6-413f-9a5c-dc13825c4dd6-kube-api-access-xjnkk\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.305493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.305358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-federate-client-tls\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.305493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.305380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21e22463-e2a6-413f-9a5c-dc13825c4dd6-serving-certs-ca-bundle\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.305493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.305405    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-secret-telemeter-client\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.305493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.305434    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-telemeter-client-tls\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.305493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.305449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21e22463-e2a6-413f-9a5c-dc13825c4dd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.305671 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.305526    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.305671 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.305560    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21e22463-e2a6-413f-9a5c-dc13825c4dd6-metrics-client-ca\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.406649 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.406597    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21e22463-e2a6-413f-9a5c-dc13825c4dd6-metrics-client-ca\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.406764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.406669    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjnkk\" (UniqueName: \"kubernetes.io/projected/21e22463-e2a6-413f-9a5c-dc13825c4dd6-kube-api-access-xjnkk\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.406764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.406708    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-federate-client-tls\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.406764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.406728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21e22463-e2a6-413f-9a5c-dc13825c4dd6-serving-certs-ca-bundle\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.406764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.406743    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-secret-telemeter-client\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.406936 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.406765    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-telemeter-client-tls\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.406936 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.406912    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21e22463-e2a6-413f-9a5c-dc13825c4dd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.407029 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.406987    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.407575 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.407545    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21e22463-e2a6-413f-9a5c-dc13825c4dd6-serving-certs-ca-bundle\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.407706 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.407545    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21e22463-e2a6-413f-9a5c-dc13825c4dd6-metrics-client-ca\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.407773 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.407744    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21e22463-e2a6-413f-9a5c-dc13825c4dd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.409805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.409776    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-telemeter-client-tls\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.409932 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.409813    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.409985 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.409928    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-secret-telemeter-client\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.410030 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.410001    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/21e22463-e2a6-413f-9a5c-dc13825c4dd6-federate-client-tls\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.414453 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.414429    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjnkk\" (UniqueName: \"kubernetes.io/projected/21e22463-e2a6-413f-9a5c-dc13825c4dd6-kube-api-access-xjnkk\") pod \"telemeter-client-d795b4686-ptg44\" (UID: \"21e22463-e2a6-413f-9a5c-dc13825c4dd6\") " pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.526844 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.526761    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d795b4686-ptg44"
Jul 01 18:12:11.665354 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.665324    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d795b4686-ptg44"]
Jul 01 18:12:11.668953 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:12:11.668920    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e22463_e2a6_413f_9a5c_dc13825c4dd6.slice/crio-34be2cba650086d375af5c65024ad4953f0e7f8e5e11cc616e794bb40b95b410 WatchSource:0}: Error finding container 34be2cba650086d375af5c65024ad4953f0e7f8e5e11cc616e794bb40b95b410: Status 404 returned error can't find the container with id 34be2cba650086d375af5c65024ad4953f0e7f8e5e11cc616e794bb40b95b410
Jul 01 18:12:11.670879 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:11.670861    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 18:12:12.668751 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:12.668710    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d795b4686-ptg44" event={"ID":"21e22463-e2a6-413f-9a5c-dc13825c4dd6","Type":"ContainerStarted","Data":"34be2cba650086d375af5c65024ad4953f0e7f8e5e11cc616e794bb40b95b410"}
Jul 01 18:12:14.678635 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:14.678592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d795b4686-ptg44" event={"ID":"21e22463-e2a6-413f-9a5c-dc13825c4dd6","Type":"ContainerStarted","Data":"794ecfa98f98f086a0fdf922b39cd80267c6b771f3623f3d3bfd7920d69a5ca8"}
Jul 01 18:12:14.679017 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:14.678665    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d795b4686-ptg44" event={"ID":"21e22463-e2a6-413f-9a5c-dc13825c4dd6","Type":"ContainerStarted","Data":"c4775c7ac4458f05d55d2257a73cf234d4259b9ee527aa66e6ff2b3aedffc079"}
Jul 01 18:12:14.679017 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:14.678699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d795b4686-ptg44" event={"ID":"21e22463-e2a6-413f-9a5c-dc13825c4dd6","Type":"ContainerStarted","Data":"a2f4d78078fbae9a62c689d314f0c404f077f3dbd142f1259eaec080258c6e67"}
Jul 01 18:12:14.701518 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:14.701460    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d795b4686-ptg44" podStartSLOduration=1.230099791 podStartE2EDuration="3.701442888s" totalImagesPullingTime="2.471343097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:12:14.699208389 +0000 UTC m=+343.929281223" watchObservedRunningTime="2026-07-01 18:12:14.701442888 +0000 UTC m=+343.931515721"
Jul 01 18:12:14.836572 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:14.836536    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:14.889363 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:14.889332    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:15.474767 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.474729    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67b8d9b748-tfd5v"]
Jul 01 18:12:15.477169 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.477146    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.489370 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.489345    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b8d9b748-tfd5v"]
Jul 01 18:12:15.575873 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.575839    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:15.630882 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.630853    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:15.645021 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.644987    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-oauth-serving-cert\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.645201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.645026    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-oauth-config\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.645201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.645052    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-trusted-ca-bundle\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.645201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.645150    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntkpw\" (UniqueName: \"kubernetes.io/projected/5f67488d-f708-4cbc-b919-5d39d54b3517-kube-api-access-ntkpw\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.645393 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.645205    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-console-config\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.645393 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.645231    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-service-ca\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.645393 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.645314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-serving-cert\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.746118 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntkpw\" (UniqueName: \"kubernetes.io/projected/5f67488d-f708-4cbc-b919-5d39d54b3517-kube-api-access-ntkpw\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.746118 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-console-config\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.746118 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746111    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-service-ca\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.746670 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746132    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-serving-cert\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.746670 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-oauth-serving-cert\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.746670 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-oauth-config\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.746670 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-trusted-ca-bundle\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.746966 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746937    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-console-config\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.747020 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746962    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-service-ca\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.747020 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.746990    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-oauth-serving-cert\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.747330 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.747307    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-trusted-ca-bundle\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.748680 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.748647    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-oauth-config\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.748821 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.748804    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-serving-cert\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.754331 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.754303    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntkpw\" (UniqueName: \"kubernetes.io/projected/5f67488d-f708-4cbc-b919-5d39d54b3517-kube-api-access-ntkpw\") pod \"console-67b8d9b748-tfd5v\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") " pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.789763 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.789723    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:15.953386 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:15.953360    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b8d9b748-tfd5v"]
Jul 01 18:12:15.956060 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:12:15.956026    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f67488d_f708_4cbc_b919_5d39d54b3517.slice/crio-fcb0cd1caf2d1cb42bde6b5918ef3141e113f54f721c5255eccfc993eae2c2c5 WatchSource:0}: Error finding container fcb0cd1caf2d1cb42bde6b5918ef3141e113f54f721c5255eccfc993eae2c2c5: Status 404 returned error can't find the container with id fcb0cd1caf2d1cb42bde6b5918ef3141e113f54f721c5255eccfc993eae2c2c5
Jul 01 18:12:16.687884 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:16.687847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b8d9b748-tfd5v" event={"ID":"5f67488d-f708-4cbc-b919-5d39d54b3517","Type":"ContainerStarted","Data":"7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8"}
Jul 01 18:12:16.688038 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:16.687936    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b8d9b748-tfd5v" event={"ID":"5f67488d-f708-4cbc-b919-5d39d54b3517","Type":"ContainerStarted","Data":"fcb0cd1caf2d1cb42bde6b5918ef3141e113f54f721c5255eccfc993eae2c2c5"}
Jul 01 18:12:16.707662 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:16.707600    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67b8d9b748-tfd5v" podStartSLOduration=1.7075829040000001 podStartE2EDuration="1.707582904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:12:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:12:16.705410583 +0000 UTC m=+345.935483417" watchObservedRunningTime="2026-07-01 18:12:16.707582904 +0000 UTC m=+345.937655807"
Jul 01 18:12:25.790208 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:25.790132    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:25.790208 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:25.790187    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:25.795069 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:25.795042    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:26.737866 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:26.737838    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:12:26.784152 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:26.784112    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c44686ddd-dcq9s"]
Jul 01 18:12:26.991494 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:26.991411    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:27.045192 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:27.045159    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:46.288854 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:46.288820    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:50.401129 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:50.401092    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:50.452281 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:50.452225    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:12:51.805094 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:51.805029    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c44686ddd-dcq9s" podUID="5e7a0d9f-2332-4780-87a2-4da66ae32875" containerName="console" containerID="cri-o://1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5" gracePeriod=15
Jul 01 18:12:52.049002 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.048977    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:12:52.145539 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.145449    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-oauth-config\") pod \"5e7a0d9f-2332-4780-87a2-4da66ae32875\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") "
Jul 01 18:12:52.145539 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.145526    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-config\") pod \"5e7a0d9f-2332-4780-87a2-4da66ae32875\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") "
Jul 01 18:12:52.145769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.145546    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-oauth-serving-cert\") pod \"5e7a0d9f-2332-4780-87a2-4da66ae32875\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") "
Jul 01 18:12:52.145769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.145568    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-trusted-ca-bundle\") pod \"5e7a0d9f-2332-4780-87a2-4da66ae32875\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") "
Jul 01 18:12:52.145769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.145595    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-serving-cert\") pod \"5e7a0d9f-2332-4780-87a2-4da66ae32875\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") "
Jul 01 18:12:52.145769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.145622    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffx4j\" (UniqueName: \"kubernetes.io/projected/5e7a0d9f-2332-4780-87a2-4da66ae32875-kube-api-access-ffx4j\") pod \"5e7a0d9f-2332-4780-87a2-4da66ae32875\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") "
Jul 01 18:12:52.145769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.145660    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-service-ca\") pod \"5e7a0d9f-2332-4780-87a2-4da66ae32875\" (UID: \"5e7a0d9f-2332-4780-87a2-4da66ae32875\") "
Jul 01 18:12:52.146145 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.146092    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-config" (OuterVolumeSpecName: "console-config") pod "5e7a0d9f-2332-4780-87a2-4da66ae32875" (UID: "5e7a0d9f-2332-4780-87a2-4da66ae32875"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:52.146145 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.146118    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5e7a0d9f-2332-4780-87a2-4da66ae32875" (UID: "5e7a0d9f-2332-4780-87a2-4da66ae32875"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:52.146145 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.146141    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5e7a0d9f-2332-4780-87a2-4da66ae32875" (UID: "5e7a0d9f-2332-4780-87a2-4da66ae32875"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:52.146435 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.146215    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-service-ca" (OuterVolumeSpecName: "service-ca") pod "5e7a0d9f-2332-4780-87a2-4da66ae32875" (UID: "5e7a0d9f-2332-4780-87a2-4da66ae32875"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:12:52.147702 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.147679    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5e7a0d9f-2332-4780-87a2-4da66ae32875" (UID: "5e7a0d9f-2332-4780-87a2-4da66ae32875"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:52.147777 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.147703    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5e7a0d9f-2332-4780-87a2-4da66ae32875" (UID: "5e7a0d9f-2332-4780-87a2-4da66ae32875"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:12:52.147856 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.147836    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e7a0d9f-2332-4780-87a2-4da66ae32875-kube-api-access-ffx4j" (OuterVolumeSpecName: "kube-api-access-ffx4j") pod "5e7a0d9f-2332-4780-87a2-4da66ae32875" (UID: "5e7a0d9f-2332-4780-87a2-4da66ae32875"). InnerVolumeSpecName "kube-api-access-ffx4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:12:52.246378 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.246340    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-serving-cert\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:52.246378 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.246374    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffx4j\" (UniqueName: \"kubernetes.io/projected/5e7a0d9f-2332-4780-87a2-4da66ae32875-kube-api-access-ffx4j\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:52.246604 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.246390    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-service-ca\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:52.246604 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.246404    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-oauth-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:52.246604 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.246419    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-console-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:52.246604 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.246433    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-oauth-serving-cert\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:52.246604 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.246445    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e7a0d9f-2332-4780-87a2-4da66ae32875-trusted-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:12:52.837758 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.837725    2567 generic.go:356] "Generic (PLEG): container finished" podID="5e7a0d9f-2332-4780-87a2-4da66ae32875" containerID="1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5" exitCode=0
Jul 01 18:12:52.838224 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.837777    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c44686ddd-dcq9s"
Jul 01 18:12:52.838224 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.837794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c44686ddd-dcq9s" event={"ID":"5e7a0d9f-2332-4780-87a2-4da66ae32875","Type":"ContainerDied","Data":"1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5"}
Jul 01 18:12:52.838224 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.837833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c44686ddd-dcq9s" event={"ID":"5e7a0d9f-2332-4780-87a2-4da66ae32875","Type":"ContainerDied","Data":"a6fa18c7f59b99f333daf77a6a5573561ece60ea8366ea35eb0b5877cc8ecd56"}
Jul 01 18:12:52.838224 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.837852    2567 scope.go:117] "RemoveContainer" containerID="1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5"
Jul 01 18:12:52.846188 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.846169    2567 scope.go:117] "RemoveContainer" containerID="1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5"
Jul 01 18:12:52.846483 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:12:52.846462    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5\": container with ID starting with 1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5 not found: ID does not exist" containerID="1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5"
Jul 01 18:12:52.846559 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.846495    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5"} err="failed to get container status \"1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5\": rpc error: code = NotFound desc = could not find container \"1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5\": container with ID starting with 1b238a4e77460482064f8b6b8bfccea47cf3eb1d6746add1b497d2fb940603f5 not found: ID does not exist"
Jul 01 18:12:52.858673 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.858642    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c44686ddd-dcq9s"]
Jul 01 18:12:52.862383 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:52.862357    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c44686ddd-dcq9s"]
Jul 01 18:12:53.426674 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:12:53.426641    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e7a0d9f-2332-4780-87a2-4da66ae32875" path="/var/lib/kubelet/pods/5e7a0d9f-2332-4780-87a2-4da66ae32875/volumes"
Jul 01 18:13:21.380927 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:21.380887    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:21.431639 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:21.431602    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:29.772496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.772460    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c7d7655d6-hmr6w"]
Jul 01 18:13:29.773010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.772935    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e7a0d9f-2332-4780-87a2-4da66ae32875" containerName="console"
Jul 01 18:13:29.773010 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.772953    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e7a0d9f-2332-4780-87a2-4da66ae32875" containerName="console"
Jul 01 18:13:29.773157 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.773071    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e7a0d9f-2332-4780-87a2-4da66ae32875" containerName="console"
Jul 01 18:13:29.775998 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.775969    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.784943 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.784915    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7d7655d6-hmr6w"]
Jul 01 18:13:29.834346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.834315    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:29.845310 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.845273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-service-ca\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.845491 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.845322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-oauth-serving-cert\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.845491 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.845367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-oauth-config\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.845491 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.845403    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djqkg\" (UniqueName: \"kubernetes.io/projected/01edbfa1-e947-4b66-9ee1-8c8af7c79631-kube-api-access-djqkg\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.845491 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.845433    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-trusted-ca-bundle\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.845491 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.845453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-serving-cert\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.845678 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.845533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-config\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.936433 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.936384    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:29.946541 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.946505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-config\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.946694 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.946560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-service-ca\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.946694 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.946586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-oauth-serving-cert\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.946694 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.946612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-oauth-config\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.946694 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.946642    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djqkg\" (UniqueName: \"kubernetes.io/projected/01edbfa1-e947-4b66-9ee1-8c8af7c79631-kube-api-access-djqkg\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.946694 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.946683    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-trusted-ca-bundle\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.946947 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.946710    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-serving-cert\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.947412 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.947382    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-config\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.947539 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.947455    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-service-ca\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.947539 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.947515    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-oauth-serving-cert\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.947652 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.947597    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-trusted-ca-bundle\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.949148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.949126    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-oauth-config\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.949366 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.949348    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-serving-cert\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:29.955678 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:29.955648    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djqkg\" (UniqueName: \"kubernetes.io/projected/01edbfa1-e947-4b66-9ee1-8c8af7c79631-kube-api-access-djqkg\") pod \"console-7c7d7655d6-hmr6w\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") " pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:30.036205 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:30.036166    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:30.086579 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:30.086545    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:30.230822 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:30.230788    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7d7655d6-hmr6w"]
Jul 01 18:13:30.235043 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:13:30.235008    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01edbfa1_e947_4b66_9ee1_8c8af7c79631.slice/crio-adfa4f021c9b309d8f476724372976bf0373835c83e1726ed64322e8f7bb267a WatchSource:0}: Error finding container adfa4f021c9b309d8f476724372976bf0373835c83e1726ed64322e8f7bb267a: Status 404 returned error can't find the container with id adfa4f021c9b309d8f476724372976bf0373835c83e1726ed64322e8f7bb267a
Jul 01 18:13:30.676764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:30.676682    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:30.737769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:30.737736    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:30.989793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:30.989705    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7d7655d6-hmr6w" event={"ID":"01edbfa1-e947-4b66-9ee1-8c8af7c79631","Type":"ContainerStarted","Data":"f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869"}
Jul 01 18:13:30.989793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:30.989753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7d7655d6-hmr6w" event={"ID":"01edbfa1-e947-4b66-9ee1-8c8af7c79631","Type":"ContainerStarted","Data":"adfa4f021c9b309d8f476724372976bf0373835c83e1726ed64322e8f7bb267a"}
Jul 01 18:13:31.006477 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:31.006427    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c7d7655d6-hmr6w" podStartSLOduration=2.006407163 podStartE2EDuration="2.006407163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:13:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:13:31.006370964 +0000 UTC m=+420.236443818" watchObservedRunningTime="2026-07-01 18:13:31.006407163 +0000 UTC m=+420.236479997"
Jul 01 18:13:33.376969 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:33.376940    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:33.442718 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:33.442686    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:37.393217 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:37.393162    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:37.703166 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:37.703078    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:40.087712 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:40.087672    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:40.088105 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:40.087759    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:40.092586 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:40.092563    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:41.035250 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:41.035206    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:13:41.080785 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:41.080745    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b8d9b748-tfd5v"]
Jul 01 18:13:41.190529 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:41.190488    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:41.290964 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:41.290883    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:13:41.345051 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:13:41.345022    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:06.104323 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.104189    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67b8d9b748-tfd5v" podUID="5f67488d-f708-4cbc-b919-5d39d54b3517" containerName="console" containerID="cri-o://7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8" gracePeriod=15
Jul 01 18:14:06.354214 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.354189    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:14:06.464128 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464032    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-serving-cert\") pod \"5f67488d-f708-4cbc-b919-5d39d54b3517\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") "
Jul 01 18:14:06.464128 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464096    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-oauth-serving-cert\") pod \"5f67488d-f708-4cbc-b919-5d39d54b3517\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") "
Jul 01 18:14:06.464128 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464117    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-console-config\") pod \"5f67488d-f708-4cbc-b919-5d39d54b3517\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") "
Jul 01 18:14:06.464451 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464164    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-service-ca\") pod \"5f67488d-f708-4cbc-b919-5d39d54b3517\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") "
Jul 01 18:14:06.464451 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464195    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-oauth-config\") pod \"5f67488d-f708-4cbc-b919-5d39d54b3517\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") "
Jul 01 18:14:06.464451 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464222    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntkpw\" (UniqueName: \"kubernetes.io/projected/5f67488d-f708-4cbc-b919-5d39d54b3517-kube-api-access-ntkpw\") pod \"5f67488d-f708-4cbc-b919-5d39d54b3517\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") "
Jul 01 18:14:06.464451 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464322    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-trusted-ca-bundle\") pod \"5f67488d-f708-4cbc-b919-5d39d54b3517\" (UID: \"5f67488d-f708-4cbc-b919-5d39d54b3517\") "
Jul 01 18:14:06.464659 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464628    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5f67488d-f708-4cbc-b919-5d39d54b3517" (UID: "5f67488d-f708-4cbc-b919-5d39d54b3517"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:14:06.464659 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464636    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-console-config" (OuterVolumeSpecName: "console-config") pod "5f67488d-f708-4cbc-b919-5d39d54b3517" (UID: "5f67488d-f708-4cbc-b919-5d39d54b3517"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:14:06.464773 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464644    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-service-ca" (OuterVolumeSpecName: "service-ca") pod "5f67488d-f708-4cbc-b919-5d39d54b3517" (UID: "5f67488d-f708-4cbc-b919-5d39d54b3517"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:14:06.464905 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.464876    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5f67488d-f708-4cbc-b919-5d39d54b3517" (UID: "5f67488d-f708-4cbc-b919-5d39d54b3517"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:14:06.466337 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.466316    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5f67488d-f708-4cbc-b919-5d39d54b3517" (UID: "5f67488d-f708-4cbc-b919-5d39d54b3517"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:14:06.466431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.466340    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f67488d-f708-4cbc-b919-5d39d54b3517-kube-api-access-ntkpw" (OuterVolumeSpecName: "kube-api-access-ntkpw") pod "5f67488d-f708-4cbc-b919-5d39d54b3517" (UID: "5f67488d-f708-4cbc-b919-5d39d54b3517"). InnerVolumeSpecName "kube-api-access-ntkpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:14:06.466431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.466412    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5f67488d-f708-4cbc-b919-5d39d54b3517" (UID: "5f67488d-f708-4cbc-b919-5d39d54b3517"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:14:06.565835 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.565779    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntkpw\" (UniqueName: \"kubernetes.io/projected/5f67488d-f708-4cbc-b919-5d39d54b3517-kube-api-access-ntkpw\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:14:06.565835 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.565827    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-trusted-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:14:06.565835 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.565837    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-serving-cert\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:14:06.565835 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.565845    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-oauth-serving-cert\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:14:06.565835 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.565853    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-console-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:14:06.565835 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.565861    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f67488d-f708-4cbc-b919-5d39d54b3517-service-ca\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:14:06.566204 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:06.565869    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f67488d-f708-4cbc-b919-5d39d54b3517-console-oauth-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:14:07.130797 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.130766    2567 generic.go:356] "Generic (PLEG): container finished" podID="5f67488d-f708-4cbc-b919-5d39d54b3517" containerID="7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8" exitCode=0
Jul 01 18:14:07.130797 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.130803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b8d9b748-tfd5v" event={"ID":"5f67488d-f708-4cbc-b919-5d39d54b3517","Type":"ContainerDied","Data":"7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8"}
Jul 01 18:14:07.131234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.130813    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b8d9b748-tfd5v"
Jul 01 18:14:07.131234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.130839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b8d9b748-tfd5v" event={"ID":"5f67488d-f708-4cbc-b919-5d39d54b3517","Type":"ContainerDied","Data":"fcb0cd1caf2d1cb42bde6b5918ef3141e113f54f721c5255eccfc993eae2c2c5"}
Jul 01 18:14:07.131234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.130859    2567 scope.go:117] "RemoveContainer" containerID="7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8"
Jul 01 18:14:07.139498 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.139477    2567 scope.go:117] "RemoveContainer" containerID="7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8"
Jul 01 18:14:07.139754 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:14:07.139738    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8\": container with ID starting with 7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8 not found: ID does not exist" containerID="7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8"
Jul 01 18:14:07.139793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.139764    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8"} err="failed to get container status \"7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8\": rpc error: code = NotFound desc = could not find container \"7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8\": container with ID starting with 7d5735356715ef1eb7c5e4762fcc2aaf014b8c17f84239463aec36d220ee90b8 not found: ID does not exist"
Jul 01 18:14:07.152894 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.152867    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b8d9b748-tfd5v"]
Jul 01 18:14:07.155003 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.154982    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67b8d9b748-tfd5v"]
Jul 01 18:14:07.426615 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:07.426534    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f67488d-f708-4cbc-b919-5d39d54b3517" path="/var/lib/kubelet/pods/5f67488d-f708-4cbc-b919-5d39d54b3517/volumes"
Jul 01 18:14:14.897717 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:14.897678    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:49.115699 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:49.115664    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:49.176323 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:49.176289    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:49.452782 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:49.452689    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:49.553545 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:49.553513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:49.656797 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:49.656765    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:14:50.434999 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.434963    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"]
Jul 01 18:14:50.435437 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.435267    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f67488d-f708-4cbc-b919-5d39d54b3517" containerName="console"
Jul 01 18:14:50.435437 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.435279    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f67488d-f708-4cbc-b919-5d39d54b3517" containerName="console"
Jul 01 18:14:50.435437 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.435346    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f67488d-f708-4cbc-b919-5d39d54b3517" containerName="console"
Jul 01 18:14:50.439675 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.439653    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.442321 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.442299    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 01 18:14:50.442442 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.442317    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c9jxg\""
Jul 01 18:14:50.443388 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.443369    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 01 18:14:50.448199 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.448180    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"]
Jul 01 18:14:50.536449 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.536416    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.536449 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.536451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.536673 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.536477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxsnq\" (UniqueName: \"kubernetes.io/projected/def1b91f-0482-42f4-ae45-9a13b75b2ae7-kube-api-access-cxsnq\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.637009 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.636980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.637171 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.637017    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.637171 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.637040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxsnq\" (UniqueName: \"kubernetes.io/projected/def1b91f-0482-42f4-ae45-9a13b75b2ae7-kube-api-access-cxsnq\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.637429 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.637407    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.637486 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.637459    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.645620 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.645585    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxsnq\" (UniqueName: \"kubernetes.io/projected/def1b91f-0482-42f4-ae45-9a13b75b2ae7-kube-api-access-cxsnq\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.749107 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.749017    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:14:50.885622 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:50.885599    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"]
Jul 01 18:14:50.888074 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:14:50.888046    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef1b91f_0482_42f4_ae45_9a13b75b2ae7.slice/crio-bc08d8c3f1699fe1727576ea8244f96c5e8f0ef882fa6d6668170e2e5f19c9cb WatchSource:0}: Error finding container bc08d8c3f1699fe1727576ea8244f96c5e8f0ef882fa6d6668170e2e5f19c9cb: Status 404 returned error can't find the container with id bc08d8c3f1699fe1727576ea8244f96c5e8f0ef882fa6d6668170e2e5f19c9cb
Jul 01 18:14:51.309935 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:51.309898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp" event={"ID":"def1b91f-0482-42f4-ae45-9a13b75b2ae7","Type":"ContainerStarted","Data":"bc08d8c3f1699fe1727576ea8244f96c5e8f0ef882fa6d6668170e2e5f19c9cb"}
Jul 01 18:14:58.342791 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:58.342750    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp" event={"ID":"def1b91f-0482-42f4-ae45-9a13b75b2ae7","Type":"ContainerStarted","Data":"e64891c5b0145df794cfba3eb3112078ec186e247aa3557f257a19025b5b7a92"}
Jul 01 18:14:59.347719 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:59.347681    2567 generic.go:356] "Generic (PLEG): container finished" podID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerID="e64891c5b0145df794cfba3eb3112078ec186e247aa3557f257a19025b5b7a92" exitCode=0
Jul 01 18:14:59.348171 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:14:59.347784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp" event={"ID":"def1b91f-0482-42f4-ae45-9a13b75b2ae7","Type":"ContainerDied","Data":"e64891c5b0145df794cfba3eb3112078ec186e247aa3557f257a19025b5b7a92"}
Jul 01 18:15:02.361052 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:02.361016    2567 generic.go:356] "Generic (PLEG): container finished" podID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerID="4fbe1f049a87669990a28ac3ff8b5f20631292e40446ef48daa28f13c09db1ae" exitCode=0
Jul 01 18:15:02.361451 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:02.361065    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp" event={"ID":"def1b91f-0482-42f4-ae45-9a13b75b2ae7","Type":"ContainerDied","Data":"4fbe1f049a87669990a28ac3ff8b5f20631292e40446ef48daa28f13c09db1ae"}
Jul 01 18:15:13.410709 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:13.410674    2567 generic.go:356] "Generic (PLEG): container finished" podID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerID="09aa1dfa0385ca080b5662eb95bfc5cd161b385059f93345c0907d159287ca67" exitCode=0
Jul 01 18:15:13.411181 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:13.410716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp" event={"ID":"def1b91f-0482-42f4-ae45-9a13b75b2ae7","Type":"ContainerDied","Data":"09aa1dfa0385ca080b5662eb95bfc5cd161b385059f93345c0907d159287ca67"}
Jul 01 18:15:14.585110 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.585070    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:15:14.647886 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.647845    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-util\") pod \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") "
Jul 01 18:15:14.647886 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.647892    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxsnq\" (UniqueName: \"kubernetes.io/projected/def1b91f-0482-42f4-ae45-9a13b75b2ae7-kube-api-access-cxsnq\") pod \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") "
Jul 01 18:15:14.648096 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.647969    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-bundle\") pod \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\" (UID: \"def1b91f-0482-42f4-ae45-9a13b75b2ae7\") "
Jul 01 18:15:14.648719 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.648691    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-bundle" (OuterVolumeSpecName: "bundle") pod "def1b91f-0482-42f4-ae45-9a13b75b2ae7" (UID: "def1b91f-0482-42f4-ae45-9a13b75b2ae7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:15:14.650174 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.650145    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def1b91f-0482-42f4-ae45-9a13b75b2ae7-kube-api-access-cxsnq" (OuterVolumeSpecName: "kube-api-access-cxsnq") pod "def1b91f-0482-42f4-ae45-9a13b75b2ae7" (UID: "def1b91f-0482-42f4-ae45-9a13b75b2ae7"). InnerVolumeSpecName "kube-api-access-cxsnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:15:14.652156 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.652127    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-util" (OuterVolumeSpecName: "util") pod "def1b91f-0482-42f4-ae45-9a13b75b2ae7" (UID: "def1b91f-0482-42f4-ae45-9a13b75b2ae7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 18:15:14.748809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.748720    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-util\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:15:14.748809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.748751    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxsnq\" (UniqueName: \"kubernetes.io/projected/def1b91f-0482-42f4-ae45-9a13b75b2ae7-kube-api-access-cxsnq\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:15:14.748809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:14.748762    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/def1b91f-0482-42f4-ae45-9a13b75b2ae7-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:15:15.421128 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:15.421100    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp"
Jul 01 18:15:15.426091 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:15.426060    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589mrjsp" event={"ID":"def1b91f-0482-42f4-ae45-9a13b75b2ae7","Type":"ContainerDied","Data":"bc08d8c3f1699fe1727576ea8244f96c5e8f0ef882fa6d6668170e2e5f19c9cb"}
Jul 01 18:15:15.426275 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:15.426108    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc08d8c3f1699fe1727576ea8244f96c5e8f0ef882fa6d6668170e2e5f19c9cb"
Jul 01 18:15:16.582138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:16.582094    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:16.696904 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:16.696873    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:18.233649 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.233617    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"]
Jul 01 18:15:18.234019 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.233897    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerName="pull"
Jul 01 18:15:18.234019 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.233907    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerName="pull"
Jul 01 18:15:18.234019 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.233921    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerName="util"
Jul 01 18:15:18.234019 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.233927    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerName="util"
Jul 01 18:15:18.234019 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.233947    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerName="extract"
Jul 01 18:15:18.234019 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.233952    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerName="extract"
Jul 01 18:15:18.234019 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.233998    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="def1b91f-0482-42f4-ae45-9a13b75b2ae7" containerName="extract"
Jul 01 18:15:18.236072 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.236056    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:18.238912 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.238892    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 01 18:15:18.239042 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.238963    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 01 18:15:18.239284 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.239259    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 01 18:15:18.239404 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.239331    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-thmg6\""
Jul 01 18:15:18.247155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.247130    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"]
Jul 01 18:15:18.280510 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.280472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/23816ecd-a760-4a71-bdc7-65b72a18d4b5-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p\" (UID: \"23816ecd-a760-4a71-bdc7-65b72a18d4b5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:18.280691 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.280517    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-969r8\" (UniqueName: \"kubernetes.io/projected/23816ecd-a760-4a71-bdc7-65b72a18d4b5-kube-api-access-969r8\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p\" (UID: \"23816ecd-a760-4a71-bdc7-65b72a18d4b5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:18.381597 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.381545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/23816ecd-a760-4a71-bdc7-65b72a18d4b5-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p\" (UID: \"23816ecd-a760-4a71-bdc7-65b72a18d4b5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:18.381787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.381696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-969r8\" (UniqueName: \"kubernetes.io/projected/23816ecd-a760-4a71-bdc7-65b72a18d4b5-kube-api-access-969r8\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p\" (UID: \"23816ecd-a760-4a71-bdc7-65b72a18d4b5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:18.383843 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.383816    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/23816ecd-a760-4a71-bdc7-65b72a18d4b5-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p\" (UID: \"23816ecd-a760-4a71-bdc7-65b72a18d4b5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:18.392652 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.392632    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-969r8\" (UniqueName: \"kubernetes.io/projected/23816ecd-a760-4a71-bdc7-65b72a18d4b5-kube-api-access-969r8\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p\" (UID: \"23816ecd-a760-4a71-bdc7-65b72a18d4b5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:18.546603 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.546568    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:18.684464 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:18.684287    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"]
Jul 01 18:15:18.689165 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:15:18.689131    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23816ecd_a760_4a71_bdc7_65b72a18d4b5.slice/crio-5e83ff0311c7c92b841d1c573b6026dae9ed03f7ff414ad84138217964c21fb8 WatchSource:0}: Error finding container 5e83ff0311c7c92b841d1c573b6026dae9ed03f7ff414ad84138217964c21fb8: Status 404 returned error can't find the container with id 5e83ff0311c7c92b841d1c573b6026dae9ed03f7ff414ad84138217964c21fb8
Jul 01 18:15:19.438917 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:19.438882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p" event={"ID":"23816ecd-a760-4a71-bdc7-65b72a18d4b5","Type":"ContainerStarted","Data":"5e83ff0311c7c92b841d1c573b6026dae9ed03f7ff414ad84138217964c21fb8"}
Jul 01 18:15:24.047462 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.047423    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:24.352349 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.352265    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-zspqm"]
Jul 01 18:15:24.354503 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.354486    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:24.359825 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.359786    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 01 18:15:24.359963 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.359837    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 01 18:15:24.359963 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.359941    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-f2lv5\""
Jul 01 18:15:24.366966 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.366940    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-zspqm"]
Jul 01 18:15:24.432022 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.431977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c1c566ac-028c-461c-8799-783ee4f7ca5a-cabundle0\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:24.432222 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.432028    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l86p\" (UniqueName: \"kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-kube-api-access-7l86p\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:24.432222 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.432164    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-certificates\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:24.464743 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.464713    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p" event={"ID":"23816ecd-a760-4a71-bdc7-65b72a18d4b5","Type":"ContainerStarted","Data":"c3477929970abc122b7a39362f9fcec1abaaac9291809d8d42aefcdc8d37b4b2"}
Jul 01 18:15:24.464947 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.464829    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:24.490234 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.490179    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p" podStartSLOduration=1.6238008659999998 podStartE2EDuration="6.490163194s" totalImagesPullingTime="4.866362328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:15:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:15:24.488606123 +0000 UTC m=+533.718678953" watchObservedRunningTime="2026-07-01 18:15:24.490163194 +0000 UTC m=+533.720236027"
Jul 01 18:15:24.533062 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.533024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-certificates\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:24.533304 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.533080    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c1c566ac-028c-461c-8799-783ee4f7ca5a-cabundle0\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:24.533304 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.533143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l86p\" (UniqueName: \"kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-kube-api-access-7l86p\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:24.533436 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:15:24.533348    2567 secret.go:281] references non-existent secret key: ca.crt
Jul 01 18:15:24.533436 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:15:24.533371    2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 01 18:15:24.533436 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:15:24.533383    2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-zspqm: references non-existent secret key: ca.crt
Jul 01 18:15:24.533575 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:15:24.533444    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-certificates podName:c1c566ac-028c-461c-8799-783ee4f7ca5a nodeName:}" failed. No retries permitted until 2026-07-01 18:15:25.033424055 +0000 UTC m=+534.263496886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-certificates") pod "keda-operator-68bff59c-zspqm" (UID: "c1c566ac-028c-461c-8799-783ee4f7ca5a") : references non-existent secret key: ca.crt
Jul 01 18:15:24.533823 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.533802    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c1c566ac-028c-461c-8799-783ee4f7ca5a-cabundle0\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:24.543895 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:24.543866    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l86p\" (UniqueName: \"kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-kube-api-access-7l86p\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:25.037096 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.037051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-certificates\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:25.037329 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:15:25.037264    2567 secret.go:281] references non-existent secret key: ca.crt
Jul 01 18:15:25.037329 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:15:25.037289    2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 01 18:15:25.037329 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:15:25.037302    2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-zspqm: references non-existent secret key: ca.crt
Jul 01 18:15:25.037504 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:15:25.037372    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-certificates podName:c1c566ac-028c-461c-8799-783ee4f7ca5a nodeName:}" failed. No retries permitted until 2026-07-01 18:15:26.037351655 +0000 UTC m=+535.267424488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-certificates") pod "keda-operator-68bff59c-zspqm" (UID: "c1c566ac-028c-461c-8799-783ee4f7ca5a") : references non-existent secret key: ca.crt
Jul 01 18:15:25.189423 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.189388    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"]
Jul 01 18:15:25.191708 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.191691    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.194122 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.194102    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 01 18:15:25.203330 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.203306    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"]
Jul 01 18:15:25.238926 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.238894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/218c67fc-8f87-4480-bf68-d8d67cdc77ba-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-xltvq\" (UID: \"218c67fc-8f87-4480-bf68-d8d67cdc77ba\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.239078 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.238994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkvf5\" (UniqueName: \"kubernetes.io/projected/218c67fc-8f87-4480-bf68-d8d67cdc77ba-kube-api-access-bkvf5\") pod \"keda-metrics-apiserver-559f75f947-xltvq\" (UID: \"218c67fc-8f87-4480-bf68-d8d67cdc77ba\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.239078 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.239025    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/218c67fc-8f87-4480-bf68-d8d67cdc77ba-certificates\") pod \"keda-metrics-apiserver-559f75f947-xltvq\" (UID: \"218c67fc-8f87-4480-bf68-d8d67cdc77ba\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.339833 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.339740    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/218c67fc-8f87-4480-bf68-d8d67cdc77ba-certificates\") pod \"keda-metrics-apiserver-559f75f947-xltvq\" (UID: \"218c67fc-8f87-4480-bf68-d8d67cdc77ba\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.339833 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.339787    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/218c67fc-8f87-4480-bf68-d8d67cdc77ba-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-xltvq\" (UID: \"218c67fc-8f87-4480-bf68-d8d67cdc77ba\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.340030 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.339980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkvf5\" (UniqueName: \"kubernetes.io/projected/218c67fc-8f87-4480-bf68-d8d67cdc77ba-kube-api-access-bkvf5\") pod \"keda-metrics-apiserver-559f75f947-xltvq\" (UID: \"218c67fc-8f87-4480-bf68-d8d67cdc77ba\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.340216 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.340196    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/218c67fc-8f87-4480-bf68-d8d67cdc77ba-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-xltvq\" (UID: \"218c67fc-8f87-4480-bf68-d8d67cdc77ba\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.342899 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.342869    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/218c67fc-8f87-4480-bf68-d8d67cdc77ba-certificates\") pod \"keda-metrics-apiserver-559f75f947-xltvq\" (UID: \"218c67fc-8f87-4480-bf68-d8d67cdc77ba\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.352324 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.352288    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkvf5\" (UniqueName: \"kubernetes.io/projected/218c67fc-8f87-4480-bf68-d8d67cdc77ba-kube-api-access-bkvf5\") pod \"keda-metrics-apiserver-559f75f947-xltvq\" (UID: \"218c67fc-8f87-4480-bf68-d8d67cdc77ba\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.502467 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.502423    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:25.637897 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:25.637869    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"]
Jul 01 18:15:25.639994 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:15:25.639965    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218c67fc_8f87_4480_bf68_d8d67cdc77ba.slice/crio-c9a13bf8d441f0cecf014ca5beab2b881807ec132cbde7c523d79c428343d002 WatchSource:0}: Error finding container c9a13bf8d441f0cecf014ca5beab2b881807ec132cbde7c523d79c428343d002: Status 404 returned error can't find the container with id c9a13bf8d441f0cecf014ca5beab2b881807ec132cbde7c523d79c428343d002
Jul 01 18:15:26.046811 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:26.046772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-certificates\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:26.049368 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:26.049346    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1c566ac-028c-461c-8799-783ee4f7ca5a-certificates\") pod \"keda-operator-68bff59c-zspqm\" (UID: \"c1c566ac-028c-461c-8799-783ee4f7ca5a\") " pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:26.164747 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:26.164706    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:26.474845 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:26.474740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq" event={"ID":"218c67fc-8f87-4480-bf68-d8d67cdc77ba","Type":"ContainerStarted","Data":"c9a13bf8d441f0cecf014ca5beab2b881807ec132cbde7c523d79c428343d002"}
Jul 01 18:15:26.501966 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:26.501928    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:26.502367 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:26.502342    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-zspqm"]
Jul 01 18:15:26.505319 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:15:26.505298    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c566ac_028c_461c_8799_783ee4f7ca5a.slice/crio-f1a29a54247a8e81050d9029163873b4cca037d9b417adecf959cd7032374330 WatchSource:0}: Error finding container f1a29a54247a8e81050d9029163873b4cca037d9b417adecf959cd7032374330: Status 404 returned error can't find the container with id f1a29a54247a8e81050d9029163873b4cca037d9b417adecf959cd7032374330
Jul 01 18:15:27.481355 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:27.481303    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-zspqm" event={"ID":"c1c566ac-028c-461c-8799-783ee4f7ca5a","Type":"ContainerStarted","Data":"f1a29a54247a8e81050d9029163873b4cca037d9b417adecf959cd7032374330"}
Jul 01 18:15:29.492622 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:29.492581    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq" event={"ID":"218c67fc-8f87-4480-bf68-d8d67cdc77ba","Type":"ContainerStarted","Data":"06c6b051a6de4c4fba3f855efe0ff39c19ea7904d3b94a67e411df41f534695e"}
Jul 01 18:15:29.493011 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:29.492724    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:29.511406 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:29.511355    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq" podStartSLOduration=1.183456126 podStartE2EDuration="4.511337651s" totalImagesPullingTime="3.327881525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:15:29.509661303 +0000 UTC m=+538.739734134" watchObservedRunningTime="2026-07-01 18:15:29.511337651 +0000 UTC m=+538.741410485"
Jul 01 18:15:33.519184 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:33.519141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-zspqm" event={"ID":"c1c566ac-028c-461c-8799-783ee4f7ca5a","Type":"ContainerStarted","Data":"b2bbc0133050e845d8e6c1981fe7270744c10465bf209be73e92b69bc28a99c7"}
Jul 01 18:15:33.519610 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:33.519260    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:15:33.538107 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:33.538048    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-zspqm" podStartSLOduration=3.378936838 podStartE2EDuration="9.538032145s" totalImagesPullingTime="6.159095307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:15:33.536149969 +0000 UTC m=+542.766222798" watchObservedRunningTime="2026-07-01 18:15:33.538032145 +0000 UTC m=+542.768105027"
Jul 01 18:15:39.689491 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:39.689449    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:15:40.503310 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:40.503277    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-xltvq"
Jul 01 18:15:45.471595 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:45.471560    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-lbd8p"
Jul 01 18:15:54.526814 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:15:54.526785    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-zspqm"
Jul 01 18:16:29.866626 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.866584    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:29.921710 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.921670    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-rtgb4"]
Jul 01 18:16:29.924481 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.924456    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:29.927098 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.927058    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 01 18:16:29.927283 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.927112    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 18:16:29.928154 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.928137    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 18:16:29.928269 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.928193    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-9kfvk\""
Jul 01 18:16:29.934259 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.934214    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-rtgb4"]
Jul 01 18:16:29.942648 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.942614    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:29.955091 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.955059    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-9ch95"]
Jul 01 18:16:29.957355 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.957335    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:29.959652 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.959631    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 01 18:16:29.959789 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.959727    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-l97mm\""
Jul 01 18:16:29.976885 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:29.976852    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-9ch95"]
Jul 01 18:16:30.003113 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.003073    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/105efe36-e66f-4722-8eea-887e2377b2ff-cert\") pod \"kserve-controller-manager-776d68c7c4-rtgb4\" (UID: \"105efe36-e66f-4722-8eea-887e2377b2ff\") " pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:30.003305 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.003138    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95nnc\" (UniqueName: \"kubernetes.io/projected/105efe36-e66f-4722-8eea-887e2377b2ff-kube-api-access-95nnc\") pod \"kserve-controller-manager-776d68c7c4-rtgb4\" (UID: \"105efe36-e66f-4722-8eea-887e2377b2ff\") " pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:30.019993 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.019956    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:30.104177 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.104143    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5046151c-dd5e-44ee-8bb6-7bf7034f7b9d-data\") pod \"seaweedfs-64568bcd49-9ch95\" (UID: \"5046151c-dd5e-44ee-8bb6-7bf7034f7b9d\") " pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:30.104383 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.104186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp69f\" (UniqueName: \"kubernetes.io/projected/5046151c-dd5e-44ee-8bb6-7bf7034f7b9d-kube-api-access-xp69f\") pod \"seaweedfs-64568bcd49-9ch95\" (UID: \"5046151c-dd5e-44ee-8bb6-7bf7034f7b9d\") " pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:30.104383 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.104230    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95nnc\" (UniqueName: \"kubernetes.io/projected/105efe36-e66f-4722-8eea-887e2377b2ff-kube-api-access-95nnc\") pod \"kserve-controller-manager-776d68c7c4-rtgb4\" (UID: \"105efe36-e66f-4722-8eea-887e2377b2ff\") " pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:30.104383 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.104363    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/105efe36-e66f-4722-8eea-887e2377b2ff-cert\") pod \"kserve-controller-manager-776d68c7c4-rtgb4\" (UID: \"105efe36-e66f-4722-8eea-887e2377b2ff\") " pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:30.104536 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:16:30.104515    2567 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 01 18:16:30.104611 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:16:30.104600    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/105efe36-e66f-4722-8eea-887e2377b2ff-cert podName:105efe36-e66f-4722-8eea-887e2377b2ff nodeName:}" failed. No retries permitted until 2026-07-01 18:16:30.604577675 +0000 UTC m=+599.834650493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/105efe36-e66f-4722-8eea-887e2377b2ff-cert") pod "kserve-controller-manager-776d68c7c4-rtgb4" (UID: "105efe36-e66f-4722-8eea-887e2377b2ff") : secret "kserve-webhook-server-cert" not found
Jul 01 18:16:30.114691 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.114655    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95nnc\" (UniqueName: \"kubernetes.io/projected/105efe36-e66f-4722-8eea-887e2377b2ff-kube-api-access-95nnc\") pod \"kserve-controller-manager-776d68c7c4-rtgb4\" (UID: \"105efe36-e66f-4722-8eea-887e2377b2ff\") " pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:30.122081 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.122016    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:30.205795 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.205751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5046151c-dd5e-44ee-8bb6-7bf7034f7b9d-data\") pod \"seaweedfs-64568bcd49-9ch95\" (UID: \"5046151c-dd5e-44ee-8bb6-7bf7034f7b9d\") " pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:30.205795 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.205794    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp69f\" (UniqueName: \"kubernetes.io/projected/5046151c-dd5e-44ee-8bb6-7bf7034f7b9d-kube-api-access-xp69f\") pod \"seaweedfs-64568bcd49-9ch95\" (UID: \"5046151c-dd5e-44ee-8bb6-7bf7034f7b9d\") " pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:30.206159 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.206136    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5046151c-dd5e-44ee-8bb6-7bf7034f7b9d-data\") pod \"seaweedfs-64568bcd49-9ch95\" (UID: \"5046151c-dd5e-44ee-8bb6-7bf7034f7b9d\") " pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:30.214338 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.214320    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp69f\" (UniqueName: \"kubernetes.io/projected/5046151c-dd5e-44ee-8bb6-7bf7034f7b9d-kube-api-access-xp69f\") pod \"seaweedfs-64568bcd49-9ch95\" (UID: \"5046151c-dd5e-44ee-8bb6-7bf7034f7b9d\") " pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:30.220787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.220725    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:30.274729 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.274683    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:30.323305 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.323232    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:30.383353 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.383223    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:30.410493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.410470    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-9ch95"]
Jul 01 18:16:30.413116 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:16:30.413089    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5046151c_dd5e_44ee_8bb6_7bf7034f7b9d.slice/crio-45f9dab910324a1075407280b9054578dd51451999bf5b55a9fb60abf1226130 WatchSource:0}: Error finding container 45f9dab910324a1075407280b9054578dd51451999bf5b55a9fb60abf1226130: Status 404 returned error can't find the container with id 45f9dab910324a1075407280b9054578dd51451999bf5b55a9fb60abf1226130
Jul 01 18:16:30.438962 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.438927    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:16:30.609942 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.609898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/105efe36-e66f-4722-8eea-887e2377b2ff-cert\") pod \"kserve-controller-manager-776d68c7c4-rtgb4\" (UID: \"105efe36-e66f-4722-8eea-887e2377b2ff\") " pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:30.612269 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.612228    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/105efe36-e66f-4722-8eea-887e2377b2ff-cert\") pod \"kserve-controller-manager-776d68c7c4-rtgb4\" (UID: \"105efe36-e66f-4722-8eea-887e2377b2ff\") " pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:30.776322 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.776212    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-9ch95" event={"ID":"5046151c-dd5e-44ee-8bb6-7bf7034f7b9d","Type":"ContainerStarted","Data":"45f9dab910324a1075407280b9054578dd51451999bf5b55a9fb60abf1226130"}
Jul 01 18:16:30.835580 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.835541    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:30.968678 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:30.968656    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-rtgb4"]
Jul 01 18:16:30.970661 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:16:30.970638    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105efe36_e66f_4722_8eea_887e2377b2ff.slice/crio-bec98305134cb50cb93b47b7a9440765744a8e7264f2420d7858de5bf55c736e WatchSource:0}: Error finding container bec98305134cb50cb93b47b7a9440765744a8e7264f2420d7858de5bf55c736e: Status 404 returned error can't find the container with id bec98305134cb50cb93b47b7a9440765744a8e7264f2420d7858de5bf55c736e
Jul 01 18:16:31.471908 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:31.471881    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:16:31.472118 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:31.472064    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:16:31.479424 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:31.479396    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:16:31.479580 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:31.479544    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:16:31.785218 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:31.785157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4" event={"ID":"105efe36-e66f-4722-8eea-887e2377b2ff","Type":"ContainerStarted","Data":"bec98305134cb50cb93b47b7a9440765744a8e7264f2420d7858de5bf55c736e"}
Jul 01 18:16:34.642572 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:34.642551    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 01 18:16:34.805461 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:34.805273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4" event={"ID":"105efe36-e66f-4722-8eea-887e2377b2ff","Type":"ContainerStarted","Data":"69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183"}
Jul 01 18:16:34.805461 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:34.805413    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:16:34.806843 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:34.806821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-9ch95" event={"ID":"5046151c-dd5e-44ee-8bb6-7bf7034f7b9d","Type":"ContainerStarted","Data":"6fe29009b9a58de059d75e5f54035b82e9a7b8928e81235de7cd59e48dbfac9e"}
Jul 01 18:16:34.806966 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:34.806953    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:34.835200 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:34.835155    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4" podStartSLOduration=2.343307499 podStartE2EDuration="5.835140874s" totalImagesPullingTime="3.491833375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:16:34.833713572 +0000 UTC m=+604.063786406" watchObservedRunningTime="2026-07-01 18:16:34.835140874 +0000 UTC m=+604.065213731"
Jul 01 18:16:34.854048 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:34.853996    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-9ch95" podStartSLOduration=1.628490089 podStartE2EDuration="5.853983801s" totalImagesPullingTime="4.225493712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:16:34.852595748 +0000 UTC m=+604.082668599" watchObservedRunningTime="2026-07-01 18:16:34.853983801 +0000 UTC m=+604.084056634"
Jul 01 18:16:40.814047 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:40.814011    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-9ch95"
Jul 01 18:16:48.685744 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:16:48.685711    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:00.526538 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:00.526453    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:05.432090 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.432056    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-rtgb4"]
Jul 01 18:17:05.432570 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.432273    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4" podUID="105efe36-e66f-4722-8eea-887e2377b2ff" containerName="manager" containerID="cri-o://69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183" gracePeriod=10
Jul 01 18:17:05.437664 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.437638    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:17:05.451199 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.451176    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-bbn6r"]
Jul 01 18:17:05.453641 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.453624    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:05.466394 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.466369    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-bbn6r"]
Jul 01 18:17:05.515971 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.515942    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljhz\" (UniqueName: \"kubernetes.io/projected/e517cca7-6d7a-422e-a71d-149891864036-kube-api-access-jljhz\") pod \"kserve-controller-manager-776d68c7c4-bbn6r\" (UID: \"e517cca7-6d7a-422e-a71d-149891864036\") " pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:05.516119 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.515985    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e517cca7-6d7a-422e-a71d-149891864036-cert\") pod \"kserve-controller-manager-776d68c7c4-bbn6r\" (UID: \"e517cca7-6d7a-422e-a71d-149891864036\") " pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:05.617128 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.617090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljhz\" (UniqueName: \"kubernetes.io/projected/e517cca7-6d7a-422e-a71d-149891864036-kube-api-access-jljhz\") pod \"kserve-controller-manager-776d68c7c4-bbn6r\" (UID: \"e517cca7-6d7a-422e-a71d-149891864036\") " pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:05.617320 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.617176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e517cca7-6d7a-422e-a71d-149891864036-cert\") pod \"kserve-controller-manager-776d68c7c4-bbn6r\" (UID: \"e517cca7-6d7a-422e-a71d-149891864036\") " pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:05.619545 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.619519    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e517cca7-6d7a-422e-a71d-149891864036-cert\") pod \"kserve-controller-manager-776d68c7c4-bbn6r\" (UID: \"e517cca7-6d7a-422e-a71d-149891864036\") " pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:05.625433 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.625405    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljhz\" (UniqueName: \"kubernetes.io/projected/e517cca7-6d7a-422e-a71d-149891864036-kube-api-access-jljhz\") pod \"kserve-controller-manager-776d68c7c4-bbn6r\" (UID: \"e517cca7-6d7a-422e-a71d-149891864036\") " pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:05.674190 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.674166    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:17:05.813465 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.813421    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:05.819494 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.819473    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95nnc\" (UniqueName: \"kubernetes.io/projected/105efe36-e66f-4722-8eea-887e2377b2ff-kube-api-access-95nnc\") pod \"105efe36-e66f-4722-8eea-887e2377b2ff\" (UID: \"105efe36-e66f-4722-8eea-887e2377b2ff\") "
Jul 01 18:17:05.819613 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.819529    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/105efe36-e66f-4722-8eea-887e2377b2ff-cert\") pod \"105efe36-e66f-4722-8eea-887e2377b2ff\" (UID: \"105efe36-e66f-4722-8eea-887e2377b2ff\") "
Jul 01 18:17:05.821699 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.821670    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/105efe36-e66f-4722-8eea-887e2377b2ff-cert" (OuterVolumeSpecName: "cert") pod "105efe36-e66f-4722-8eea-887e2377b2ff" (UID: "105efe36-e66f-4722-8eea-887e2377b2ff"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:17:05.821809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.821677    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/105efe36-e66f-4722-8eea-887e2377b2ff-kube-api-access-95nnc" (OuterVolumeSpecName: "kube-api-access-95nnc") pod "105efe36-e66f-4722-8eea-887e2377b2ff" (UID: "105efe36-e66f-4722-8eea-887e2377b2ff"). InnerVolumeSpecName "kube-api-access-95nnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:17:05.920844 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.920816    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95nnc\" (UniqueName: \"kubernetes.io/projected/105efe36-e66f-4722-8eea-887e2377b2ff-kube-api-access-95nnc\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:17:05.920844 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.920842    2567 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/105efe36-e66f-4722-8eea-887e2377b2ff-cert\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:17:05.935722 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.935702    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-bbn6r"]
Jul 01 18:17:05.937934 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:17:05.937910    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode517cca7_6d7a_422e_a71d_149891864036.slice/crio-a339007b16a54d2b2b4c9501b27719ef48c44d900a49a06a142d4555d1bd1bce WatchSource:0}: Error finding container a339007b16a54d2b2b4c9501b27719ef48c44d900a49a06a142d4555d1bd1bce: Status 404 returned error can't find the container with id a339007b16a54d2b2b4c9501b27719ef48c44d900a49a06a142d4555d1bd1bce
Jul 01 18:17:05.948925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.948902    2567 generic.go:356] "Generic (PLEG): container finished" podID="105efe36-e66f-4722-8eea-887e2377b2ff" containerID="69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183" exitCode=0
Jul 01 18:17:05.949032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.948950    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4"
Jul 01 18:17:05.949032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.948970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4" event={"ID":"105efe36-e66f-4722-8eea-887e2377b2ff","Type":"ContainerDied","Data":"69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183"}
Jul 01 18:17:05.949032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.949018    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-rtgb4" event={"ID":"105efe36-e66f-4722-8eea-887e2377b2ff","Type":"ContainerDied","Data":"bec98305134cb50cb93b47b7a9440765744a8e7264f2420d7858de5bf55c736e"}
Jul 01 18:17:05.949197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.949043    2567 scope.go:117] "RemoveContainer" containerID="69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183"
Jul 01 18:17:05.950165 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.950146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r" event={"ID":"e517cca7-6d7a-422e-a71d-149891864036","Type":"ContainerStarted","Data":"a339007b16a54d2b2b4c9501b27719ef48c44d900a49a06a142d4555d1bd1bce"}
Jul 01 18:17:05.957830 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.957812    2567 scope.go:117] "RemoveContainer" containerID="69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183"
Jul 01 18:17:05.958081 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:17:05.958064    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183\": container with ID starting with 69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183 not found: ID does not exist" containerID="69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183"
Jul 01 18:17:05.958161 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.958089    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183"} err="failed to get container status \"69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183\": rpc error: code = NotFound desc = could not find container \"69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183\": container with ID starting with 69c4602308344e185c2fed1198fdc9e44334792f93f73a9a1449776790573183 not found: ID does not exist"
Jul 01 18:17:05.971320 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.971294    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-rtgb4"]
Jul 01 18:17:05.975269 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:05.975230    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-rtgb4"]
Jul 01 18:17:06.956336 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:06.956302    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r" event={"ID":"e517cca7-6d7a-422e-a71d-149891864036","Type":"ContainerStarted","Data":"2340263afbec14bb488a60c91ce3c4cdf75e8978523809eae57ee995b0e4b5a0"}
Jul 01 18:17:06.956898 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:06.956458    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:06.972883 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:06.972823    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r" podStartSLOduration=1.531869324 podStartE2EDuration="1.972809555s" totalImagesPullingTime="440.940231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:17:06.971668069 +0000 UTC m=+636.201740903" watchObservedRunningTime="2026-07-01 18:17:06.972809555 +0000 UTC m=+636.202882389"
Jul 01 18:17:07.427017 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:07.426977    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="105efe36-e66f-4722-8eea-887e2377b2ff" path="/var/lib/kubelet/pods/105efe36-e66f-4722-8eea-887e2377b2ff/volumes"
Jul 01 18:17:13.551385 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:13.551352    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:13.601629 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:13.601593    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:16.039167 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.039127    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68f55f76f5-pm7xs"]
Jul 01 18:17:16.039569 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.039524    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="105efe36-e66f-4722-8eea-887e2377b2ff" containerName="manager"
Jul 01 18:17:16.039569 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.039539    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="105efe36-e66f-4722-8eea-887e2377b2ff" containerName="manager"
Jul 01 18:17:16.039643 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.039609    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="105efe36-e66f-4722-8eea-887e2377b2ff" containerName="manager"
Jul 01 18:17:16.042825 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.042803    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.053482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.053455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68f55f76f5-pm7xs"]
Jul 01 18:17:16.088757 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.088709    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:16.115644 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.115613    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-service-ca\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.115826 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.115652    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-oauth-serving-cert\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.115826 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.115683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bed88497-794d-4270-ae0a-caad013043e0-console-serving-cert\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.115826 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.115797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bed88497-794d-4270-ae0a-caad013043e0-console-oauth-config\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.115991 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.115834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-trusted-ca-bundle\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.115991 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.115862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-console-config\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.115991 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.115903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c99n\" (UniqueName: \"kubernetes.io/projected/bed88497-794d-4270-ae0a-caad013043e0-kube-api-access-6c99n\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.159270 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.159224    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:16.216598 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.216569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bed88497-794d-4270-ae0a-caad013043e0-console-oauth-config\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.216778 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.216606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-trusted-ca-bundle\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.216778 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.216634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-console-config\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.216778 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.216667    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c99n\" (UniqueName: \"kubernetes.io/projected/bed88497-794d-4270-ae0a-caad013043e0-kube-api-access-6c99n\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.216778 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.216723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-service-ca\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.216778 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.216763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-oauth-serving-cert\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.217036 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.216802    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bed88497-794d-4270-ae0a-caad013043e0-console-serving-cert\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.217625 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.217591    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-console-config\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.217758 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.217602    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-oauth-serving-cert\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.217758 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.217686    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-service-ca\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.217758 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.217699    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bed88497-794d-4270-ae0a-caad013043e0-trusted-ca-bundle\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.219129 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.219099    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bed88497-794d-4270-ae0a-caad013043e0-console-oauth-config\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.219274 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.219259    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bed88497-794d-4270-ae0a-caad013043e0-console-serving-cert\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.224453 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.224429    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c99n\" (UniqueName: \"kubernetes.io/projected/bed88497-794d-4270-ae0a-caad013043e0-kube-api-access-6c99n\") pod \"console-68f55f76f5-pm7xs\" (UID: \"bed88497-794d-4270-ae0a-caad013043e0\") " pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.242272 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.242229    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:16.343774 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.343689    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:16.354830 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.354796    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:16.498954 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:16.498893    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68f55f76f5-pm7xs"]
Jul 01 18:17:16.501432 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:17:16.501398    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed88497_794d_4270_ae0a_caad013043e0.slice/crio-fa908175b71a2a8b1b42ea95af67af9f5b7fcb436e3bbc0a491e6de8edff5264 WatchSource:0}: Error finding container fa908175b71a2a8b1b42ea95af67af9f5b7fcb436e3bbc0a491e6de8edff5264: Status 404 returned error can't find the container with id fa908175b71a2a8b1b42ea95af67af9f5b7fcb436e3bbc0a491e6de8edff5264
Jul 01 18:17:17.002047 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:17.002015    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f55f76f5-pm7xs" event={"ID":"bed88497-794d-4270-ae0a-caad013043e0","Type":"ContainerStarted","Data":"0da8fe0ffa5a887dd8148c64a7cc97fb2c199dd27fea224414e9e979f1323b9d"}
Jul 01 18:17:17.002223 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:17.002061    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68f55f76f5-pm7xs" event={"ID":"bed88497-794d-4270-ae0a-caad013043e0","Type":"ContainerStarted","Data":"fa908175b71a2a8b1b42ea95af67af9f5b7fcb436e3bbc0a491e6de8edff5264"}
Jul 01 18:17:17.023096 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:17.023049    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68f55f76f5-pm7xs" podStartSLOduration=1.023032973 podStartE2EDuration="1.023032973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:17:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:17:17.021108145 +0000 UTC m=+646.251180978" watchObservedRunningTime="2026-07-01 18:17:17.023032973 +0000 UTC m=+646.253105806"
Jul 01 18:17:17.136776 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:17.136713    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:17.200291 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:17.200228    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:26.355765 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:26.355715    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:26.356325 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:26.355812    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:26.360945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:26.360926    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:27.051870 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:27.051844    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68f55f76f5-pm7xs"
Jul 01 18:17:27.098973 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:27.098944    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7d7655d6-hmr6w"]
Jul 01 18:17:27.307907 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:27.307819    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:27.409546 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:27.409508    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:37.668277 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:37.668223    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:37.965792 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:37.965705    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-776d68c7c4-bbn6r"
Jul 01 18:17:39.017474 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.017429    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:39.050768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.050740    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-qp752"]
Jul 01 18:17:39.053264 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.053232    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:39.056963 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.056939    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-5p5ds\""
Jul 01 18:17:39.057075 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.056983    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 01 18:17:39.063939 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.063917    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-qp752"]
Jul 01 18:17:39.093344 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.093323    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:39.116541 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.116517    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43-tls-certs\") pod \"model-serving-api-fd65d7d6-qp752\" (UID: \"9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43\") " pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:39.116666 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.116545    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6sq2\" (UniqueName: \"kubernetes.io/projected/9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43-kube-api-access-h6sq2\") pod \"model-serving-api-fd65d7d6-qp752\" (UID: \"9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43\") " pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:39.194941 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.194916    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:39.217285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.217262    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43-tls-certs\") pod \"model-serving-api-fd65d7d6-qp752\" (UID: \"9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43\") " pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:39.217369 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.217290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6sq2\" (UniqueName: \"kubernetes.io/projected/9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43-kube-api-access-h6sq2\") pod \"model-serving-api-fd65d7d6-qp752\" (UID: \"9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43\") " pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:39.219527 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.219508    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43-tls-certs\") pod \"model-serving-api-fd65d7d6-qp752\" (UID: \"9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43\") " pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:39.225517 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.225498    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6sq2\" (UniqueName: \"kubernetes.io/projected/9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43-kube-api-access-h6sq2\") pod \"model-serving-api-fd65d7d6-qp752\" (UID: \"9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43\") " pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:39.365592 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.365570    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:39.492143 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.492115    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-qp752"]
Jul 01 18:17:39.494160 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:17:39.494136    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1e23f0_63a9_4fe3_8d7f_a11e09f5ed43.slice/crio-800a33971c4b80698a44b82f8b2830f775be617d87fe354438ea6b71de06f2c6 WatchSource:0}: Error finding container 800a33971c4b80698a44b82f8b2830f775be617d87fe354438ea6b71de06f2c6: Status 404 returned error can't find the container with id 800a33971c4b80698a44b82f8b2830f775be617d87fe354438ea6b71de06f2c6
Jul 01 18:17:39.496073 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.496058    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 18:17:39.622923 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.622829    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:39.723608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.723575    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:39.802158 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:39.802126    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:17:40.107761 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:40.107736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-qp752" event={"ID":"9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43","Type":"ContainerStarted","Data":"800a33971c4b80698a44b82f8b2830f775be617d87fe354438ea6b71de06f2c6"}
Jul 01 18:17:42.118477 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:42.118444    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-qp752" event={"ID":"9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43","Type":"ContainerStarted","Data":"3d6e0f5f13440323cfb20e4677905567dc434ff04e850f2f4d2edbfcbb7a0851"}
Jul 01 18:17:42.118831 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:42.118521    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:42.136070 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:42.136022    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-qp752" podStartSLOduration=0.602485059 podStartE2EDuration="3.136007352s" totalImagesPullingTime="2.533522293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:17:42.135635941 +0000 UTC m=+671.365708788" watchObservedRunningTime="2026-07-01 18:17:42.136007352 +0000 UTC m=+671.366080186"
Jul 01 18:17:52.119745 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.119703    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c7d7655d6-hmr6w" podUID="01edbfa1-e947-4b66-9ee1-8c8af7c79631" containerName="console" containerID="cri-o://f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869" gracePeriod=15
Jul 01 18:17:52.361041 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.361014    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:17:52.438146 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438046    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-oauth-config\") pod \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") "
Jul 01 18:17:52.438146 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438087    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-oauth-serving-cert\") pod \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") "
Jul 01 18:17:52.438146 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438118    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djqkg\" (UniqueName: \"kubernetes.io/projected/01edbfa1-e947-4b66-9ee1-8c8af7c79631-kube-api-access-djqkg\") pod \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") "
Jul 01 18:17:52.438460 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438160    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-config\") pod \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") "
Jul 01 18:17:52.438460 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438195    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-trusted-ca-bundle\") pod \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") "
Jul 01 18:17:52.438460 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438213    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-service-ca\") pod \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") "
Jul 01 18:17:52.438460 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438230    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-serving-cert\") pod \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\" (UID: \"01edbfa1-e947-4b66-9ee1-8c8af7c79631\") "
Jul 01 18:17:52.438669 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438576    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-config" (OuterVolumeSpecName: "console-config") pod "01edbfa1-e947-4b66-9ee1-8c8af7c79631" (UID: "01edbfa1-e947-4b66-9ee1-8c8af7c79631"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:17:52.438669 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438591    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "01edbfa1-e947-4b66-9ee1-8c8af7c79631" (UID: "01edbfa1-e947-4b66-9ee1-8c8af7c79631"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:17:52.438760 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438660    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "01edbfa1-e947-4b66-9ee1-8c8af7c79631" (UID: "01edbfa1-e947-4b66-9ee1-8c8af7c79631"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:17:52.438760 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.438696    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-service-ca" (OuterVolumeSpecName: "service-ca") pod "01edbfa1-e947-4b66-9ee1-8c8af7c79631" (UID: "01edbfa1-e947-4b66-9ee1-8c8af7c79631"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:17:52.440395 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.440374    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "01edbfa1-e947-4b66-9ee1-8c8af7c79631" (UID: "01edbfa1-e947-4b66-9ee1-8c8af7c79631"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:17:52.440864 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.440840    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "01edbfa1-e947-4b66-9ee1-8c8af7c79631" (UID: "01edbfa1-e947-4b66-9ee1-8c8af7c79631"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:17:52.440864 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.440854    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01edbfa1-e947-4b66-9ee1-8c8af7c79631-kube-api-access-djqkg" (OuterVolumeSpecName: "kube-api-access-djqkg") pod "01edbfa1-e947-4b66-9ee1-8c8af7c79631" (UID: "01edbfa1-e947-4b66-9ee1-8c8af7c79631"). InnerVolumeSpecName "kube-api-access-djqkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:17:52.538986 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.538942    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-oauth-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:17:52.538986 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.538978    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-oauth-serving-cert\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:17:52.538986 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.538988    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djqkg\" (UniqueName: \"kubernetes.io/projected/01edbfa1-e947-4b66-9ee1-8c8af7c79631-kube-api-access-djqkg\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:17:52.538986 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.538998    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:17:52.539299 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.539007    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-trusted-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:17:52.539299 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.539017    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01edbfa1-e947-4b66-9ee1-8c8af7c79631-service-ca\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:17:52.539299 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:52.539024    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01edbfa1-e947-4b66-9ee1-8c8af7c79631-console-serving-cert\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:17:53.128001 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.127971    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-qp752"
Jul 01 18:17:53.171476 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.171439    2567 generic.go:356] "Generic (PLEG): container finished" podID="01edbfa1-e947-4b66-9ee1-8c8af7c79631" containerID="f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869" exitCode=0
Jul 01 18:17:53.171639 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.171482    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7d7655d6-hmr6w"
Jul 01 18:17:53.171639 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.171526    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7d7655d6-hmr6w" event={"ID":"01edbfa1-e947-4b66-9ee1-8c8af7c79631","Type":"ContainerDied","Data":"f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869"}
Jul 01 18:17:53.171639 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.171573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7d7655d6-hmr6w" event={"ID":"01edbfa1-e947-4b66-9ee1-8c8af7c79631","Type":"ContainerDied","Data":"adfa4f021c9b309d8f476724372976bf0373835c83e1726ed64322e8f7bb267a"}
Jul 01 18:17:53.171639 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.171599    2567 scope.go:117] "RemoveContainer" containerID="f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869"
Jul 01 18:17:53.180944 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.180928    2567 scope.go:117] "RemoveContainer" containerID="f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869"
Jul 01 18:17:53.181262 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:17:53.181221    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869\": container with ID starting with f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869 not found: ID does not exist" containerID="f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869"
Jul 01 18:17:53.181401 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.181378    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869"} err="failed to get container status \"f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869\": rpc error: code = NotFound desc = could not find container \"f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869\": container with ID starting with f99703950f5929793f5bfd0abc075ac6a5d5731a83b0326b2a5c80889326d869 not found: ID does not exist"
Jul 01 18:17:53.194410 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.194382    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7d7655d6-hmr6w"]
Jul 01 18:17:53.197160 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.197136    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c7d7655d6-hmr6w"]
Jul 01 18:17:53.426926 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:17:53.426845    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01edbfa1-e947-4b66-9ee1-8c8af7c79631" path="/var/lib/kubelet/pods/01edbfa1-e947-4b66-9ee1-8c8af7c79631/volumes"
Jul 01 18:19:15.529587 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:15.529551    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:15.617582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:15.617546    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:27.533597 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.533566    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:27.576801 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.576769    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"]
Jul 01 18:19:27.577446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.577424    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01edbfa1-e947-4b66-9ee1-8c8af7c79631" containerName="console"
Jul 01 18:19:27.577446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.577446    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="01edbfa1-e947-4b66-9ee1-8c8af7c79631" containerName="console"
Jul 01 18:19:27.577628 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.577525    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="01edbfa1-e947-4b66-9ee1-8c8af7c79631" containerName="console"
Jul 01 18:19:27.580645 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.580623    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.583137 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.583119    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-4d812-kube-rbac-proxy-sar-config\""
Jul 01 18:19:27.583270 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.583150    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 18:19:27.583270 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.583120    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 18:19:27.584299 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.584284    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-4d812-predictor-serving-cert\""
Jul 01 18:19:27.584421 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.584407    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fg8rn\""
Jul 01 18:19:27.590131 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.590108    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"]
Jul 01 18:19:27.609127 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.609094    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:27.671679 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.671647    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") " pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.671679 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.671690    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twpkq\" (UniqueName: \"kubernetes.io/projected/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-api-access-twpkq\") pod \"success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") " pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.671922 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.671732    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-proxy-tls\") pod \"success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") " pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.772841 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.772804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") " pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.772841 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.772847    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twpkq\" (UniqueName: \"kubernetes.io/projected/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-api-access-twpkq\") pod \"success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") " pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.773093 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.772893    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-proxy-tls\") pod \"success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") " pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.773496 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.773476    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") " pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.775220 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.775189    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-proxy-tls\") pod \"success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") " pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.781353 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.781327    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twpkq\" (UniqueName: \"kubernetes.io/projected/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-api-access-twpkq\") pod \"success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") " pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:27.827769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.827694    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:27.893490 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:27.893324    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:28.037153 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:28.037118    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:28.066364 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:28.066321    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"]
Jul 01 18:19:28.069897 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:19:28.069870    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce57eb2b_fcf3_4a6a_8f78_3a164b55582e.slice/crio-873749d5a344e162e9d08b7f708fe9fbe9f220f235f211cc84fb5bc0670d23cf WatchSource:0}: Error finding container 873749d5a344e162e9d08b7f708fe9fbe9f220f235f211cc84fb5bc0670d23cf: Status 404 returned error can't find the container with id 873749d5a344e162e9d08b7f708fe9fbe9f220f235f211cc84fb5bc0670d23cf
Jul 01 18:19:28.149108 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:28.149024    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:28.248205 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:28.248173    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:28.307374 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:28.307338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:28.595526 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:28.595469    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" event={"ID":"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e","Type":"ContainerStarted","Data":"873749d5a344e162e9d08b7f708fe9fbe9f220f235f211cc84fb5bc0670d23cf"}
Jul 01 18:19:29.292880 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:29.292824    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:29.395881 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:29.395842    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:34.590492 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:34.590450    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:19:41.673436 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:41.673402    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" event={"ID":"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e","Type":"ContainerStarted","Data":"666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c"}
Jul 01 18:19:44.693552 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:44.693458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" event={"ID":"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e","Type":"ContainerStarted","Data":"81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e"}
Jul 01 18:19:44.693968 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:44.693669    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:44.693968 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:44.693839    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:44.695330 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:44.695303    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 18:19:44.711266 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:44.711210    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" podStartSLOduration=1.557822209 podStartE2EDuration="17.71119857s" totalImagesPullingTime="16.153376361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:19:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:19:44.709298884 +0000 UTC m=+793.939371720" watchObservedRunningTime="2026-07-01 18:19:44.71119857 +0000 UTC m=+793.941271478"
Jul 01 18:19:45.698470 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:45.698433    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 18:19:50.702989 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:50.702953    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:19:50.703422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:19:50.703394    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 18:20:00.704521 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:00.704426    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 18:20:08.615442 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:08.615409    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:20:08.717348 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:08.717304    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:20:10.703650 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:10.703612    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 18:20:20.703606 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:20.703562    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 18:20:30.704424 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:30.704393    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:20:47.649144 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.649111    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"]
Jul 01 18:20:47.651440 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.651421    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:47.651955 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.651931    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:20:47.654136 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.654118    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-4d812-serving-cert\""
Jul 01 18:20:47.654263 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.654137    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-4d812-kube-rbac-proxy-sar-config\""
Jul 01 18:20:47.659936 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.659916    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"]
Jul 01 18:20:47.675997 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.675967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4b5f0c-abed-4bc9-abf9-36062c41567a-openshift-service-ca-bundle\") pod \"switch-graph-4d812-656c86c8f8-ggh6z\" (UID: \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\") " pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:47.676138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.676061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7c4b5f0c-abed-4bc9-abf9-36062c41567a-proxy-tls\") pod \"switch-graph-4d812-656c86c8f8-ggh6z\" (UID: \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\") " pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:47.777618 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.777578    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7c4b5f0c-abed-4bc9-abf9-36062c41567a-proxy-tls\") pod \"switch-graph-4d812-656c86c8f8-ggh6z\" (UID: \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\") " pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:47.777809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.777679    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4b5f0c-abed-4bc9-abf9-36062c41567a-openshift-service-ca-bundle\") pod \"switch-graph-4d812-656c86c8f8-ggh6z\" (UID: \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\") " pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:47.777809 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:20:47.777734    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-4d812-serving-cert: secret "switch-graph-4d812-serving-cert" not found
Jul 01 18:20:47.777885 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:20:47.777814    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4b5f0c-abed-4bc9-abf9-36062c41567a-proxy-tls podName:7c4b5f0c-abed-4bc9-abf9-36062c41567a nodeName:}" failed. No retries permitted until 2026-07-01 18:20:48.277792768 +0000 UTC m=+857.507865593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/7c4b5f0c-abed-4bc9-abf9-36062c41567a-proxy-tls") pod "switch-graph-4d812-656c86c8f8-ggh6z" (UID: "7c4b5f0c-abed-4bc9-abf9-36062c41567a") : secret "switch-graph-4d812-serving-cert" not found
Jul 01 18:20:47.778406 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:47.778387    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4b5f0c-abed-4bc9-abf9-36062c41567a-openshift-service-ca-bundle\") pod \"switch-graph-4d812-656c86c8f8-ggh6z\" (UID: \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\") " pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:48.282400 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:48.282344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7c4b5f0c-abed-4bc9-abf9-36062c41567a-proxy-tls\") pod \"switch-graph-4d812-656c86c8f8-ggh6z\" (UID: \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\") " pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:48.284769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:48.284749    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7c4b5f0c-abed-4bc9-abf9-36062c41567a-proxy-tls\") pod \"switch-graph-4d812-656c86c8f8-ggh6z\" (UID: \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\") " pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:48.563188 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:48.563090    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:48.692129 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:48.692105    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"]
Jul 01 18:20:48.694250 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:20:48.694213    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4b5f0c_abed_4bc9_abf9_36062c41567a.slice/crio-3286f5d8f143b0b3740f4dba8a306678a63425455ed06f7a98aa4719c5f96e88 WatchSource:0}: Error finding container 3286f5d8f143b0b3740f4dba8a306678a63425455ed06f7a98aa4719c5f96e88: Status 404 returned error can't find the container with id 3286f5d8f143b0b3740f4dba8a306678a63425455ed06f7a98aa4719c5f96e88
Jul 01 18:20:48.996173 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:48.990638    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:20:49.001001 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:49.000969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" event={"ID":"7c4b5f0c-abed-4bc9-abf9-36062c41567a","Type":"ContainerStarted","Data":"3286f5d8f143b0b3740f4dba8a306678a63425455ed06f7a98aa4719c5f96e88"}
Jul 01 18:20:53.021837 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:53.021797    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" event={"ID":"7c4b5f0c-abed-4bc9-abf9-36062c41567a","Type":"ContainerStarted","Data":"2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079"}
Jul 01 18:20:53.022352 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:53.021885    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:20:53.040493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:53.040445    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" podStartSLOduration=2.655370978 podStartE2EDuration="6.040429561s" totalImagesPullingTime="3.385058583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:20:53.038309962 +0000 UTC m=+862.268382794" watchObservedRunningTime="2026-07-01 18:20:53.040429561 +0000 UTC m=+862.270502393"
Jul 01 18:20:59.032313 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:20:59.032283    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:21:01.887488 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:01.887451    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"]
Jul 01 18:21:01.887897 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:01.887703    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812" containerID="cri-o://2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079" gracePeriod=30
Jul 01 18:21:01.911728 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:01.911696    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:02.038304 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.038267    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"]
Jul 01 18:21:02.038564 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.038534    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container" containerID="cri-o://666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c" gracePeriod=30
Jul 01 18:21:02.038930 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.038901    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kube-rbac-proxy" containerID="cri-o://81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e" gracePeriod=30
Jul 01 18:21:02.052787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.052725    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:02.092677 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.092637    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"]
Jul 01 18:21:02.096047 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.096025    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.098946 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.098924    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2588a-predictor-serving-cert\""
Jul 01 18:21:02.099084 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.099004    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-2588a-kube-rbac-proxy-sar-config\""
Jul 01 18:21:02.105979 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.105953    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"]
Jul 01 18:21:02.153170 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.153084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:02.201625 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.201581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.201966 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.201936    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhcx2\" (UniqueName: \"kubernetes.io/projected/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-api-access-mhcx2\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.202101 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.202060    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d63a87c1-08fd-4f19-8191-3f90d1eb4669-proxy-tls\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.227549 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.227502    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:02.288727 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.288692    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:02.302858 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.302828    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.303033 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.302874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhcx2\" (UniqueName: \"kubernetes.io/projected/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-api-access-mhcx2\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.303033 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.302924    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d63a87c1-08fd-4f19-8191-3f90d1eb4669-proxy-tls\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.303150 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:21:02.303038    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-2588a-predictor-serving-cert: secret "success-200-isvc-2588a-predictor-serving-cert" not found
Jul 01 18:21:02.303150 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:21:02.303095    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d63a87c1-08fd-4f19-8191-3f90d1eb4669-proxy-tls podName:d63a87c1-08fd-4f19-8191-3f90d1eb4669 nodeName:}" failed. No retries permitted until 2026-07-01 18:21:02.80307663 +0000 UTC m=+872.033149453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d63a87c1-08fd-4f19-8191-3f90d1eb4669-proxy-tls") pod "success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" (UID: "d63a87c1-08fd-4f19-8191-3f90d1eb4669") : secret "success-200-isvc-2588a-predictor-serving-cert" not found
Jul 01 18:21:02.303608 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.303589    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.313724 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.313693    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhcx2\" (UniqueName: \"kubernetes.io/projected/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-api-access-mhcx2\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.534990 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.534956    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:02.636535 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.636488    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:02.807930 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.807838    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d63a87c1-08fd-4f19-8191-3f90d1eb4669-proxy-tls\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:02.810188 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:02.810163    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d63a87c1-08fd-4f19-8191-3f90d1eb4669-proxy-tls\") pod \"success-200-isvc-2588a-predictor-748cbcd5cd-52g7s\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") " pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:03.007673 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:03.007625    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:03.077669 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:03.077480    2567 generic.go:356] "Generic (PLEG): container finished" podID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerID="81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e" exitCode=2
Jul 01 18:21:03.077669 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:03.077585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" event={"ID":"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e","Type":"ContainerDied","Data":"81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e"}
Jul 01 18:21:03.140674 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:03.140651    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"]
Jul 01 18:21:03.142850 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:21:03.142817    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63a87c1_08fd_4f19_8191_3f90d1eb4669.slice/crio-2a20f302e89bac1be9caa5aeccd64ca2cec893e984806de0ce2fa845ffeeb9a6 WatchSource:0}: Error finding container 2a20f302e89bac1be9caa5aeccd64ca2cec893e984806de0ce2fa845ffeeb9a6: Status 404 returned error can't find the container with id 2a20f302e89bac1be9caa5aeccd64ca2cec893e984806de0ce2fa845ffeeb9a6
Jul 01 18:21:04.031768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:04.031731    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:04.084264 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:04.084218    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" event={"ID":"d63a87c1-08fd-4f19-8191-3f90d1eb4669","Type":"ContainerStarted","Data":"81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f"}
Jul 01 18:21:04.084446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:04.084289    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" event={"ID":"d63a87c1-08fd-4f19-8191-3f90d1eb4669","Type":"ContainerStarted","Data":"707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e"}
Jul 01 18:21:04.084446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:04.084310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" event={"ID":"d63a87c1-08fd-4f19-8191-3f90d1eb4669","Type":"ContainerStarted","Data":"2a20f302e89bac1be9caa5aeccd64ca2cec893e984806de0ce2fa845ffeeb9a6"}
Jul 01 18:21:04.084446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:04.084381    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:04.102375 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:04.102327    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" podStartSLOduration=2.102310925 podStartE2EDuration="2.102310925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:21:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:21:04.100353536 +0000 UTC m=+873.330426369" watchObservedRunningTime="2026-07-01 18:21:04.102310925 +0000 UTC m=+873.332383758"
Jul 01 18:21:05.089188 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.089157    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:05.090840 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.090808    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 01 18:21:05.287711 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.287689    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:21:05.329720 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.329689    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-rbac-proxy-sar-config\") pod \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") "
Jul 01 18:21:05.329913 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.329751    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twpkq\" (UniqueName: \"kubernetes.io/projected/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-api-access-twpkq\") pod \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") "
Jul 01 18:21:05.329913 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.329857    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-proxy-tls\") pod \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\" (UID: \"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e\") "
Jul 01 18:21:05.330132 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.330108    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" (UID: "ce57eb2b-fcf3-4a6a-8f78-3a164b55582e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:21:05.331968 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.331940    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" (UID: "ce57eb2b-fcf3-4a6a-8f78-3a164b55582e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:21:05.332067 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.332006    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-api-access-twpkq" (OuterVolumeSpecName: "kube-api-access-twpkq") pod "ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" (UID: "ce57eb2b-fcf3-4a6a-8f78-3a164b55582e"). InnerVolumeSpecName "kube-api-access-twpkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:21:05.430840 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.430745    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:21:05.430840 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.430770    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:21:05.430840 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:05.430780    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twpkq\" (UniqueName: \"kubernetes.io/projected/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e-kube-api-access-twpkq\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:21:06.094816 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.094784    2567 generic.go:356] "Generic (PLEG): container finished" podID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerID="666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c" exitCode=0
Jul 01 18:21:06.095207 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.094840    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"
Jul 01 18:21:06.095207 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.094865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" event={"ID":"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e","Type":"ContainerDied","Data":"666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c"}
Jul 01 18:21:06.095207 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.094932    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd" event={"ID":"ce57eb2b-fcf3-4a6a-8f78-3a164b55582e","Type":"ContainerDied","Data":"873749d5a344e162e9d08b7f708fe9fbe9f220f235f211cc84fb5bc0670d23cf"}
Jul 01 18:21:06.095207 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.094970    2567 scope.go:117] "RemoveContainer" containerID="81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e"
Jul 01 18:21:06.095429 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.095366    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 01 18:21:06.106274 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.106250    2567 scope.go:117] "RemoveContainer" containerID="666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c"
Jul 01 18:21:06.113150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.113126    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"]
Jul 01 18:21:06.114403 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.114387    2567 scope.go:117] "RemoveContainer" containerID="81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e"
Jul 01 18:21:06.114649 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:21:06.114629    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e\": container with ID starting with 81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e not found: ID does not exist" containerID="81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e"
Jul 01 18:21:06.114717 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.114656    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e"} err="failed to get container status \"81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e\": rpc error: code = NotFound desc = could not find container \"81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e\": container with ID starting with 81e1f0fc397638d7f23033f012f38de6b31d84eaadddd4f61cba2d14a23a548e not found: ID does not exist"
Jul 01 18:21:06.114717 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.114673    2567 scope.go:117] "RemoveContainer" containerID="666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c"
Jul 01 18:21:06.114897 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:21:06.114882    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c\": container with ID starting with 666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c not found: ID does not exist" containerID="666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c"
Jul 01 18:21:06.114943 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.114902    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c"} err="failed to get container status \"666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c\": rpc error: code = NotFound desc = could not find container \"666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c\": container with ID starting with 666ad15b54d05b48cf98d165218bac7ea10e122f4a1c05e9a7709d49bf34231c not found: ID does not exist"
Jul 01 18:21:06.118515 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:06.118495    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4d812-predictor-6f5465f7b8-s2kqd"]
Jul 01 18:21:07.427641 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:07.427605    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" path="/var/lib/kubelet/pods/ce57eb2b-fcf3-4a6a-8f78-3a164b55582e/volumes"
Jul 01 18:21:09.033091 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:09.033042    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:11.099583 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:11.099558    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:11.100004 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:11.099974    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 01 18:21:14.030451 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:14.030412    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:14.030827 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:14.030543    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:21:16.936695 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:16.936663    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:16.996157 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:16.996115    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:19.030931 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:19.030885    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:21.100476 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:21.100438    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 01 18:21:24.031990 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:24.031892    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:29.031316 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:29.031275    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:29.045009 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:29.044980    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:31.100199 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:31.100149    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 01 18:21:31.501812 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:31.501782    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:21:31.503046 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:31.503024    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:21:31.507957 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:31.507935    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:21:31.509313 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:31.509298    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:21:32.035162 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.035136    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:21:32.175792 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.175703    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4b5f0c-abed-4bc9-abf9-36062c41567a-openshift-service-ca-bundle\") pod \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\" (UID: \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\") "
Jul 01 18:21:32.175792 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.175749    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7c4b5f0c-abed-4bc9-abf9-36062c41567a-proxy-tls\") pod \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\" (UID: \"7c4b5f0c-abed-4bc9-abf9-36062c41567a\") "
Jul 01 18:21:32.176193 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.176089    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c4b5f0c-abed-4bc9-abf9-36062c41567a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "7c4b5f0c-abed-4bc9-abf9-36062c41567a" (UID: "7c4b5f0c-abed-4bc9-abf9-36062c41567a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:21:32.177805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.177782    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c4b5f0c-abed-4bc9-abf9-36062c41567a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7c4b5f0c-abed-4bc9-abf9-36062c41567a" (UID: "7c4b5f0c-abed-4bc9-abf9-36062c41567a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:21:32.218878 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.218845    2567 generic.go:356] "Generic (PLEG): container finished" podID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerID="2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079" exitCode=0
Jul 01 18:21:32.219045 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.218894    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"
Jul 01 18:21:32.219045 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.218935    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" event={"ID":"7c4b5f0c-abed-4bc9-abf9-36062c41567a","Type":"ContainerDied","Data":"2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079"}
Jul 01 18:21:32.219045 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.218993    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z" event={"ID":"7c4b5f0c-abed-4bc9-abf9-36062c41567a","Type":"ContainerDied","Data":"3286f5d8f143b0b3740f4dba8a306678a63425455ed06f7a98aa4719c5f96e88"}
Jul 01 18:21:32.219045 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.219020    2567 scope.go:117] "RemoveContainer" containerID="2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079"
Jul 01 18:21:32.228039 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.228016    2567 scope.go:117] "RemoveContainer" containerID="2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079"
Jul 01 18:21:32.228371 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:21:32.228344    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079\": container with ID starting with 2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079 not found: ID does not exist" containerID="2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079"
Jul 01 18:21:32.228450 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.228382    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079"} err="failed to get container status \"2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079\": rpc error: code = NotFound desc = could not find container \"2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079\": container with ID starting with 2dca67bd39432b24e179b7134593799ef5ad618bfbd44c2471cab705c2ee3079 not found: ID does not exist"
Jul 01 18:21:32.240019 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.239992    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"]
Jul 01 18:21:32.243686 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.243665    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4d812-656c86c8f8-ggh6z"]
Jul 01 18:21:32.276366 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.276336    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c4b5f0c-abed-4bc9-abf9-36062c41567a-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:21:32.276366 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:32.276362    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7c4b5f0c-abed-4bc9-abf9-36062c41567a-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:21:33.426846 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:33.426816    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" path="/var/lib/kubelet/pods/7c4b5f0c-abed-4bc9-abf9-36062c41567a/volumes"
Jul 01 18:21:41.100994 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:41.100951    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Jul 01 18:21:47.639500 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639459    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"]
Jul 01 18:21:47.639869 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639815    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container"
Jul 01 18:21:47.639869 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639825    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container"
Jul 01 18:21:47.639869 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639844    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812"
Jul 01 18:21:47.639869 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639849    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812"
Jul 01 18:21:47.639869 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639857    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kube-rbac-proxy"
Jul 01 18:21:47.639869 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639863    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kube-rbac-proxy"
Jul 01 18:21:47.640075 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639916    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kserve-container"
Jul 01 18:21:47.640075 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639925    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c4b5f0c-abed-4bc9-abf9-36062c41567a" containerName="switch-graph-4d812"
Jul 01 18:21:47.640075 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.639932    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce57eb2b-fcf3-4a6a-8f78-3a164b55582e" containerName="kube-rbac-proxy"
Jul 01 18:21:47.642498 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.642470    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:47.642901 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.642885    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:47.645177 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.645158    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 01 18:21:47.645426 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.645377    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 01 18:21:47.649541 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.649515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"]
Jul 01 18:21:47.703641 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.703596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e0f452-f799-4720-b9ef-7969cedb6e2e-openshift-service-ca-bundle\") pod \"model-chainer-b57d5bf9d-6cg52\" (UID: \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\") " pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:47.703808 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.703682    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e0f452-f799-4720-b9ef-7969cedb6e2e-proxy-tls\") pod \"model-chainer-b57d5bf9d-6cg52\" (UID: \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\") " pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:47.804922 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.804887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e0f452-f799-4720-b9ef-7969cedb6e2e-proxy-tls\") pod \"model-chainer-b57d5bf9d-6cg52\" (UID: \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\") " pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:47.805101 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.804967    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e0f452-f799-4720-b9ef-7969cedb6e2e-openshift-service-ca-bundle\") pod \"model-chainer-b57d5bf9d-6cg52\" (UID: \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\") " pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:47.805745 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.805709    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e0f452-f799-4720-b9ef-7969cedb6e2e-openshift-service-ca-bundle\") pod \"model-chainer-b57d5bf9d-6cg52\" (UID: \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\") " pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:47.807575 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.807549    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e0f452-f799-4720-b9ef-7969cedb6e2e-proxy-tls\") pod \"model-chainer-b57d5bf9d-6cg52\" (UID: \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\") " pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:47.842581 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.842553    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:47.954004 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:47.953921    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:48.087718 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:48.087694    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"]
Jul 01 18:21:48.089796 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:21:48.089766    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e0f452_f799_4720_b9ef_7969cedb6e2e.slice/crio-cb1e5d138225939ef391a29a8f7d9f957430f39e8498782a956ffc8170ae56cb WatchSource:0}: Error finding container cb1e5d138225939ef391a29a8f7d9f957430f39e8498782a956ffc8170ae56cb: Status 404 returned error can't find the container with id cb1e5d138225939ef391a29a8f7d9f957430f39e8498782a956ffc8170ae56cb
Jul 01 18:21:48.295489 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:48.295449    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" event={"ID":"c2e0f452-f799-4720-b9ef-7969cedb6e2e","Type":"ContainerStarted","Data":"11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d"}
Jul 01 18:21:48.295663 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:48.295511    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" event={"ID":"c2e0f452-f799-4720-b9ef-7969cedb6e2e","Type":"ContainerStarted","Data":"cb1e5d138225939ef391a29a8f7d9f957430f39e8498782a956ffc8170ae56cb"}
Jul 01 18:21:48.295708 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:48.295671    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:48.312933 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:48.312886    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" podStartSLOduration=1.312870675 podStartE2EDuration="1.312870675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:21:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:21:48.310488024 +0000 UTC m=+917.540560856" watchObservedRunningTime="2026-07-01 18:21:48.312870675 +0000 UTC m=+917.542943537"
Jul 01 18:21:51.101423 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:51.101393    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:21:54.305595 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:54.305564    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:21:57.743786 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.743755    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"]
Jul 01 18:21:57.744226 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.743991    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer" containerID="cri-o://11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d" gracePeriod=30
Jul 01 18:21:57.914084 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.914054    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"]
Jul 01 18:21:57.917299 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.917279    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:57.919581 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.919560    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c5c10-kube-rbac-proxy-sar-config\""
Jul 01 18:21:57.919880 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.919858    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c5c10-predictor-serving-cert\""
Jul 01 18:21:57.929330 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.929310    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"]
Jul 01 18:21:57.991539 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.991513    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:57.991692 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.991630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-proxy-tls\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:57.991692 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:57.991669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9w4m\" (UniqueName: \"kubernetes.io/projected/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-api-access-n9w4m\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:58.003570 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.003502    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:58.092955 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.092931    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:58.093098 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.093018    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-proxy-tls\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:58.093098 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.093041    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9w4m\" (UniqueName: \"kubernetes.io/projected/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-api-access-n9w4m\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:58.093209 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:21:58.093147    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-serving-cert: secret "success-200-isvc-c5c10-predictor-serving-cert" not found
Jul 01 18:21:58.093277 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:21:58.093260    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-proxy-tls podName:2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2 nodeName:}" failed. No retries permitted until 2026-07-01 18:21:58.593222473 +0000 UTC m=+927.823295299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-proxy-tls") pod "success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" (UID: "2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2") : secret "success-200-isvc-c5c10-predictor-serving-cert" not found
Jul 01 18:21:58.093702 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.093679    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:58.101867 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.101844    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9w4m\" (UniqueName: \"kubernetes.io/projected/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-api-access-n9w4m\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:58.102460 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.102436    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:58.403066 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.403039    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:58.596671 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.596643    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-proxy-tls\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:58.598806 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.598782    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-proxy-tls\") pod \"success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") " pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:58.787925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.787900    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:21:58.830936 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.830913    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:58.953093 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:58.953070    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"]
Jul 01 18:21:58.955025 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:21:58.955000    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3f6391_8a2a_4d4c_8d28_ed8d9843d2b2.slice/crio-9a60ff03d83ffc10f77df4bf6af4b044a1d9d0473ae7a4d44c75750cdcb7691a WatchSource:0}: Error finding container 9a60ff03d83ffc10f77df4bf6af4b044a1d9d0473ae7a4d44c75750cdcb7691a: Status 404 returned error can't find the container with id 9a60ff03d83ffc10f77df4bf6af4b044a1d9d0473ae7a4d44c75750cdcb7691a
Jul 01 18:21:59.303965 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:59.303886    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:21:59.356790 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:59.356764    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" event={"ID":"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2","Type":"ContainerStarted","Data":"cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1"}
Jul 01 18:21:59.356923 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:59.356813    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" event={"ID":"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2","Type":"ContainerStarted","Data":"dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2"}
Jul 01 18:21:59.356923 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:59.356837    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:59.356923 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:59.356856    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" event={"ID":"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2","Type":"ContainerStarted","Data":"9a60ff03d83ffc10f77df4bf6af4b044a1d9d0473ae7a4d44c75750cdcb7691a"}
Jul 01 18:21:59.356923 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:59.356875    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:21:59.358290 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:59.358270    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Jul 01 18:21:59.376505 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:21:59.376467    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" podStartSLOduration=2.376453428 podStartE2EDuration="2.376453428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:21:59.374098846 +0000 UTC m=+928.604171691" watchObservedRunningTime="2026-07-01 18:21:59.376453428 +0000 UTC m=+928.606526259"
Jul 01 18:22:00.360916 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:00.360880    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Jul 01 18:22:02.114461 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.114428    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"]
Jul 01 18:22:02.116935 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.116920    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:02.119784 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.119762    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-2588a-serving-cert\""
Jul 01 18:22:02.120005 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.119988    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-2588a-kube-rbac-proxy-sar-config\""
Jul 01 18:22:02.127910 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.127884    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:22:02.128936 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.128914    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"]
Jul 01 18:22:02.220356 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.220337    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee45e391-e73c-4dd3-8759-494ede34c0dc-proxy-tls\") pod \"switch-graph-2588a-79864c4578-t2p5b\" (UID: \"ee45e391-e73c-4dd3-8759-494ede34c0dc\") " pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:02.220454 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.220364    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee45e391-e73c-4dd3-8759-494ede34c0dc-openshift-service-ca-bundle\") pod \"switch-graph-2588a-79864c4578-t2p5b\" (UID: \"ee45e391-e73c-4dd3-8759-494ede34c0dc\") " pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:02.320692 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.320670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee45e391-e73c-4dd3-8759-494ede34c0dc-proxy-tls\") pod \"switch-graph-2588a-79864c4578-t2p5b\" (UID: \"ee45e391-e73c-4dd3-8759-494ede34c0dc\") " pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:02.320777 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.320699    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee45e391-e73c-4dd3-8759-494ede34c0dc-openshift-service-ca-bundle\") pod \"switch-graph-2588a-79864c4578-t2p5b\" (UID: \"ee45e391-e73c-4dd3-8759-494ede34c0dc\") " pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:02.320833 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:22:02.320817    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-2588a-serving-cert: secret "switch-graph-2588a-serving-cert" not found
Jul 01 18:22:02.320896 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:22:02.320885    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee45e391-e73c-4dd3-8759-494ede34c0dc-proxy-tls podName:ee45e391-e73c-4dd3-8759-494ede34c0dc nodeName:}" failed. No retries permitted until 2026-07-01 18:22:02.820865925 +0000 UTC m=+932.050938751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ee45e391-e73c-4dd3-8759-494ede34c0dc-proxy-tls") pod "switch-graph-2588a-79864c4578-t2p5b" (UID: "ee45e391-e73c-4dd3-8759-494ede34c0dc") : secret "switch-graph-2588a-serving-cert" not found
Jul 01 18:22:02.321371 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.321356    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee45e391-e73c-4dd3-8759-494ede34c0dc-openshift-service-ca-bundle\") pod \"switch-graph-2588a-79864c4578-t2p5b\" (UID: \"ee45e391-e73c-4dd3-8759-494ede34c0dc\") " pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:02.458390 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.458339    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:22:02.824897 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.824874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee45e391-e73c-4dd3-8759-494ede34c0dc-proxy-tls\") pod \"switch-graph-2588a-79864c4578-t2p5b\" (UID: \"ee45e391-e73c-4dd3-8759-494ede34c0dc\") " pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:02.827180 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:02.827154    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee45e391-e73c-4dd3-8759-494ede34c0dc-proxy-tls\") pod \"switch-graph-2588a-79864c4578-t2p5b\" (UID: \"ee45e391-e73c-4dd3-8759-494ede34c0dc\") " pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:03.028056 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:03.028035    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:03.150972 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:03.150950    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"]
Jul 01 18:22:03.152668 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:22:03.152646    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee45e391_e73c_4dd3_8759_494ede34c0dc.slice/crio-4472d03cf9380e9d00aad48f29958f26abdea620ce3f52874abb5c99ff014878 WatchSource:0}: Error finding container 4472d03cf9380e9d00aad48f29958f26abdea620ce3f52874abb5c99ff014878: Status 404 returned error can't find the container with id 4472d03cf9380e9d00aad48f29958f26abdea620ce3f52874abb5c99ff014878
Jul 01 18:22:03.377050 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:03.376981    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" event={"ID":"ee45e391-e73c-4dd3-8759-494ede34c0dc","Type":"ContainerStarted","Data":"48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19"}
Jul 01 18:22:03.377050 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:03.377030    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" event={"ID":"ee45e391-e73c-4dd3-8759-494ede34c0dc","Type":"ContainerStarted","Data":"4472d03cf9380e9d00aad48f29958f26abdea620ce3f52874abb5c99ff014878"}
Jul 01 18:22:03.377231 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:03.377118    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:03.394254 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:03.394209    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" podStartSLOduration=1.394195456 podStartE2EDuration="1.394195456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:22:03.393467642 +0000 UTC m=+932.623540474" watchObservedRunningTime="2026-07-01 18:22:03.394195456 +0000 UTC m=+932.624268283"
Jul 01 18:22:04.303056 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:04.303025    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:05.365284 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:05.365235    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:22:05.365686 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:05.365590    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Jul 01 18:22:09.303887 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:09.303849    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:09.304344 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:09.303957    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:22:09.392305 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:09.392279    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:22:14.303455 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:14.303419    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:15.366673 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:15.366632    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Jul 01 18:22:19.303577 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:19.303537    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:24.303346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:24.303302    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:22:25.365999 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:25.365958    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Jul 01 18:22:27.887654 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:27.887630    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:22:28.025221 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.025140    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e0f452-f799-4720-b9ef-7969cedb6e2e-proxy-tls\") pod \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\" (UID: \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\") "
Jul 01 18:22:28.025221 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.025211    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e0f452-f799-4720-b9ef-7969cedb6e2e-openshift-service-ca-bundle\") pod \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\" (UID: \"c2e0f452-f799-4720-b9ef-7969cedb6e2e\") "
Jul 01 18:22:28.025626 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.025601    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2e0f452-f799-4720-b9ef-7969cedb6e2e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c2e0f452-f799-4720-b9ef-7969cedb6e2e" (UID: "c2e0f452-f799-4720-b9ef-7969cedb6e2e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:22:28.027095 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.027073    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2e0f452-f799-4720-b9ef-7969cedb6e2e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c2e0f452-f799-4720-b9ef-7969cedb6e2e" (UID: "c2e0f452-f799-4720-b9ef-7969cedb6e2e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:22:28.126204 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.126178    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2e0f452-f799-4720-b9ef-7969cedb6e2e-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:22:28.126204 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.126200    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c2e0f452-f799-4720-b9ef-7969cedb6e2e-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:22:28.496464 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.496431    2567 generic.go:356] "Generic (PLEG): container finished" podID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerID="11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d" exitCode=0
Jul 01 18:22:28.496635 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.496473    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"
Jul 01 18:22:28.496635 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.496503    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" event={"ID":"c2e0f452-f799-4720-b9ef-7969cedb6e2e","Type":"ContainerDied","Data":"11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d"}
Jul 01 18:22:28.496635 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.496545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52" event={"ID":"c2e0f452-f799-4720-b9ef-7969cedb6e2e","Type":"ContainerDied","Data":"cb1e5d138225939ef391a29a8f7d9f957430f39e8498782a956ffc8170ae56cb"}
Jul 01 18:22:28.496635 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.496569    2567 scope.go:117] "RemoveContainer" containerID="11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d"
Jul 01 18:22:28.505149 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.505131    2567 scope.go:117] "RemoveContainer" containerID="11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d"
Jul 01 18:22:28.505435 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:22:28.505417    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d\": container with ID starting with 11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d not found: ID does not exist" containerID="11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d"
Jul 01 18:22:28.505500 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.505444    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d"} err="failed to get container status \"11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d\": rpc error: code = NotFound desc = could not find container \"11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d\": container with ID starting with 11cac8c33ebc5a0fb3ad61b126161669f5dd0f9158199d4dde6b29208b18b28d not found: ID does not exist"
Jul 01 18:22:28.518228 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.518203    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"]
Jul 01 18:22:28.521447 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:28.521423    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b57d5bf9d-6cg52"]
Jul 01 18:22:29.426819 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:29.426789    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" path="/var/lib/kubelet/pods/c2e0f452-f799-4720-b9ef-7969cedb6e2e/volumes"
Jul 01 18:22:35.366138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:35.366098    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Jul 01 18:22:45.367312 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:45.367281    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:22:57.931417 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.931334    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"]
Jul 01 18:22:57.931902 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.931882    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer"
Jul 01 18:22:57.931979 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.931906    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer"
Jul 01 18:22:57.932031 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.932013    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2e0f452-f799-4720-b9ef-7969cedb6e2e" containerName="model-chainer"
Jul 01 18:22:57.934025 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.934005    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:22:57.936449 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.936427    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-c5c10-kube-rbac-proxy-sar-config\""
Jul 01 18:22:57.936449 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.936444    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-c5c10-serving-cert\""
Jul 01 18:22:57.945152 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.945132    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"]
Jul 01 18:22:57.949750 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.949728    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:22:57.971133 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.971106    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1901c013-03ed-4930-adf2-b88b17961d79-proxy-tls\") pod \"sequence-graph-c5c10-7b978df757-rw5r6\" (UID: \"1901c013-03ed-4930-adf2-b88b17961d79\") " pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:22:57.971233 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:57.971209    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1901c013-03ed-4930-adf2-b88b17961d79-openshift-service-ca-bundle\") pod \"sequence-graph-c5c10-7b978df757-rw5r6\" (UID: \"1901c013-03ed-4930-adf2-b88b17961d79\") " pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:22:58.042917 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.042890    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:22:58.071798 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.071778    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1901c013-03ed-4930-adf2-b88b17961d79-proxy-tls\") pod \"sequence-graph-c5c10-7b978df757-rw5r6\" (UID: \"1901c013-03ed-4930-adf2-b88b17961d79\") " pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:22:58.071919 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.071851    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1901c013-03ed-4930-adf2-b88b17961d79-openshift-service-ca-bundle\") pod \"sequence-graph-c5c10-7b978df757-rw5r6\" (UID: \"1901c013-03ed-4930-adf2-b88b17961d79\") " pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:22:58.072473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.072455    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1901c013-03ed-4930-adf2-b88b17961d79-openshift-service-ca-bundle\") pod \"sequence-graph-c5c10-7b978df757-rw5r6\" (UID: \"1901c013-03ed-4930-adf2-b88b17961d79\") " pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:22:58.074120 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.074103    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1901c013-03ed-4930-adf2-b88b17961d79-proxy-tls\") pod \"sequence-graph-c5c10-7b978df757-rw5r6\" (UID: \"1901c013-03ed-4930-adf2-b88b17961d79\") " pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:22:58.245194 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.245130    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:22:58.370202 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.370178    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"]
Jul 01 18:22:58.371586 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:22:58.371557    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1901c013_03ed_4930_adf2_b88b17961d79.slice/crio-6f69566cdf9292e5ea0517cd2a96ae811822c77b781fcf88376dcaefd80f022a WatchSource:0}: Error finding container 6f69566cdf9292e5ea0517cd2a96ae811822c77b781fcf88376dcaefd80f022a: Status 404 returned error can't find the container with id 6f69566cdf9292e5ea0517cd2a96ae811822c77b781fcf88376dcaefd80f022a
Jul 01 18:22:58.630034 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.629998    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" event={"ID":"1901c013-03ed-4930-adf2-b88b17961d79","Type":"ContainerStarted","Data":"e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba"}
Jul 01 18:22:58.630198 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.630058    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" event={"ID":"1901c013-03ed-4930-adf2-b88b17961d79","Type":"ContainerStarted","Data":"6f69566cdf9292e5ea0517cd2a96ae811822c77b781fcf88376dcaefd80f022a"}
Jul 01 18:22:58.630198 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.630096    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:22:58.647915 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:22:58.647861    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" podStartSLOduration=1.647842366 podStartE2EDuration="1.647842366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:22:58.646035293 +0000 UTC m=+987.876108127" watchObservedRunningTime="2026-07-01 18:22:58.647842366 +0000 UTC m=+987.877915199"
Jul 01 18:23:04.640566 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:23:04.640538    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:24:47.836064 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:24:47.836012    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:26:31.529354 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:26:31.529329    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:26:31.534124 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:26:31.534101    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:26:31.536822 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:26:31.536800    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:26:31.540408 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:26:31.540383    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:30:16.691342 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.691311    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"]
Jul 01 18:30:16.691816 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.691551    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a" containerID="cri-o://48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19" gracePeriod=30
Jul 01 18:30:16.921981 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.921951    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"]
Jul 01 18:30:16.926449 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.926427    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:16.929915 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.929567    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0d3ed-predictor-serving-cert\""
Jul 01 18:30:16.929915 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.929789    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0d3ed-kube-rbac-proxy-sar-config\""
Jul 01 18:30:16.934578 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.932584    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"]
Jul 01 18:30:16.936838 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.936812    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"]
Jul 01 18:30:16.937330 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.937301    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container" containerID="cri-o://707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e" gracePeriod=30
Jul 01 18:30:16.937611 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:16.937590    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kube-rbac-proxy" containerID="cri-o://81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f" gracePeriod=30
Jul 01 18:30:17.037219 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.037191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d720426e-8bce-4003-bc5a-36fa7a4a3349-proxy-tls\") pod \"success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") " pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.037370 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.037267    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") " pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.037435 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.037377    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtnk9\" (UniqueName: \"kubernetes.io/projected/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-api-access-dtnk9\") pod \"success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") " pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.138398 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.138374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") " pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.138528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.138431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtnk9\" (UniqueName: \"kubernetes.io/projected/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-api-access-dtnk9\") pod \"success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") " pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.138528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.138462    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d720426e-8bce-4003-bc5a-36fa7a4a3349-proxy-tls\") pod \"success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") " pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.138988 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.138968    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") " pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.140585 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.140568    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d720426e-8bce-4003-bc5a-36fa7a4a3349-proxy-tls\") pod \"success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") " pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.145933 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.145915    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtnk9\" (UniqueName: \"kubernetes.io/projected/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-api-access-dtnk9\") pod \"success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") " pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.251671 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.251620    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.372788 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.372760    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"]
Jul 01 18:30:17.374516 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:30:17.374494    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd720426e_8bce_4003_bc5a_36fa7a4a3349.slice/crio-c6b2f54138db3c143ddcfe606bcd9ef0b1ff8d1c490a31eca402e184f5b4cd1c WatchSource:0}: Error finding container c6b2f54138db3c143ddcfe606bcd9ef0b1ff8d1c490a31eca402e184f5b4cd1c: Status 404 returned error can't find the container with id c6b2f54138db3c143ddcfe606bcd9ef0b1ff8d1c490a31eca402e184f5b4cd1c
Jul 01 18:30:17.546272 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.546231    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" event={"ID":"d720426e-8bce-4003-bc5a-36fa7a4a3349","Type":"ContainerStarted","Data":"ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525"}
Jul 01 18:30:17.546407 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.546310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" event={"ID":"d720426e-8bce-4003-bc5a-36fa7a4a3349","Type":"ContainerStarted","Data":"5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce"}
Jul 01 18:30:17.546407 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.546341    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" event={"ID":"d720426e-8bce-4003-bc5a-36fa7a4a3349","Type":"ContainerStarted","Data":"c6b2f54138db3c143ddcfe606bcd9ef0b1ff8d1c490a31eca402e184f5b4cd1c"}
Jul 01 18:30:17.546407 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.546375    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.546579 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.546507    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:17.548048 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.548021    2567 generic.go:356] "Generic (PLEG): container finished" podID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerID="81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f" exitCode=2
Jul 01 18:30:17.548148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.548071    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" event={"ID":"d63a87c1-08fd-4f19-8191-3f90d1eb4669","Type":"ContainerDied","Data":"81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f"}
Jul 01 18:30:17.548148 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.548129    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Jul 01 18:30:17.564884 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:17.564844    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podStartSLOduration=1.564834399 podStartE2EDuration="1.564834399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:30:17.563480323 +0000 UTC m=+1426.793553160" watchObservedRunningTime="2026-07-01 18:30:17.564834399 +0000 UTC m=+1426.794907302"
Jul 01 18:30:18.099664 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:18.099636    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:30:18.553285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:18.553256    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Jul 01 18:30:19.386144 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.386108    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:30:19.392547 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.392529    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:30:19.558867 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.558843    2567 generic.go:356] "Generic (PLEG): container finished" podID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerID="707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e" exitCode=0
Jul 01 18:30:19.558980 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.558884    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"
Jul 01 18:30:19.558980 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.558904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" event={"ID":"d63a87c1-08fd-4f19-8191-3f90d1eb4669","Type":"ContainerDied","Data":"707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e"}
Jul 01 18:30:19.558980 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.558957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s" event={"ID":"d63a87c1-08fd-4f19-8191-3f90d1eb4669","Type":"ContainerDied","Data":"2a20f302e89bac1be9caa5aeccd64ca2cec893e984806de0ce2fa845ffeeb9a6"}
Jul 01 18:30:19.559080 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.558986    2567 scope.go:117] "RemoveContainer" containerID="81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f"
Jul 01 18:30:19.559439 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.559419    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d63a87c1-08fd-4f19-8191-3f90d1eb4669-proxy-tls\") pod \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") "
Jul 01 18:30:19.559554 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.559491    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhcx2\" (UniqueName: \"kubernetes.io/projected/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-api-access-mhcx2\") pod \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") "
Jul 01 18:30:19.559554 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.559547    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-rbac-proxy-sar-config\") pod \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\" (UID: \"d63a87c1-08fd-4f19-8191-3f90d1eb4669\") "
Jul 01 18:30:19.559950 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.559928    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d63a87c1-08fd-4f19-8191-3f90d1eb4669" (UID: "d63a87c1-08fd-4f19-8191-3f90d1eb4669"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:30:19.561373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.561351    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63a87c1-08fd-4f19-8191-3f90d1eb4669-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d63a87c1-08fd-4f19-8191-3f90d1eb4669" (UID: "d63a87c1-08fd-4f19-8191-3f90d1eb4669"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:30:19.561484 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.561448    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-api-access-mhcx2" (OuterVolumeSpecName: "kube-api-access-mhcx2") pod "d63a87c1-08fd-4f19-8191-3f90d1eb4669" (UID: "d63a87c1-08fd-4f19-8191-3f90d1eb4669"). InnerVolumeSpecName "kube-api-access-mhcx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:30:19.576329 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.576312    2567 scope.go:117] "RemoveContainer" containerID="707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e"
Jul 01 18:30:19.594718 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.594701    2567 scope.go:117] "RemoveContainer" containerID="81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f"
Jul 01 18:30:19.595022 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:30:19.595005    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f\": container with ID starting with 81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f not found: ID does not exist" containerID="81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f"
Jul 01 18:30:19.595097 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.595029    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f"} err="failed to get container status \"81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f\": rpc error: code = NotFound desc = could not find container \"81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f\": container with ID starting with 81f1631efce27ebfa85473aaf28b5db7bf106b188ec3fe2909c27b788eef283f not found: ID does not exist"
Jul 01 18:30:19.595097 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.595046    2567 scope.go:117] "RemoveContainer" containerID="707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e"
Jul 01 18:30:19.595281 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:30:19.595264    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e\": container with ID starting with 707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e not found: ID does not exist" containerID="707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e"
Jul 01 18:30:19.595337 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.595286    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e"} err="failed to get container status \"707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e\": rpc error: code = NotFound desc = could not find container \"707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e\": container with ID starting with 707df503ff542d165271f5b7a68eb4422e116a529e9bedf71fe0f74aaf88f25e not found: ID does not exist"
Jul 01 18:30:19.660217 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.660196    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:30:19.660217 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.660215    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d63a87c1-08fd-4f19-8191-3f90d1eb4669-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:30:19.660344 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.660225    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhcx2\" (UniqueName: \"kubernetes.io/projected/d63a87c1-08fd-4f19-8191-3f90d1eb4669-kube-api-access-mhcx2\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:30:19.861677 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.861625    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:30:19.878324 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.878291    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"]
Jul 01 18:30:19.880463 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:19.880442    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-2588a-predictor-748cbcd5cd-52g7s"]
Jul 01 18:30:21.426355 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:21.426325    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" path="/var/lib/kubelet/pods/d63a87c1-08fd-4f19-8191-3f90d1eb4669/volumes"
Jul 01 18:30:23.557316 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:23.557256    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:30:23.557642 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:23.557617    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Jul 01 18:30:24.386426 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:24.386390    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:30:29.385743 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:29.385712    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:30:29.386113 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:29.385817    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:30:33.558179 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:33.558138    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Jul 01 18:30:34.385465 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:34.385432    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:30:39.385623 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:39.385587    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:30:43.558588 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:43.558557    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Jul 01 18:30:44.385777 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:44.385745    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:30:46.834949 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:46.834927    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:30:46.846961 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:46.846942    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee45e391-e73c-4dd3-8759-494ede34c0dc-proxy-tls\") pod \"ee45e391-e73c-4dd3-8759-494ede34c0dc\" (UID: \"ee45e391-e73c-4dd3-8759-494ede34c0dc\") "
Jul 01 18:30:46.847018 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:46.846998    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee45e391-e73c-4dd3-8759-494ede34c0dc-openshift-service-ca-bundle\") pod \"ee45e391-e73c-4dd3-8759-494ede34c0dc\" (UID: \"ee45e391-e73c-4dd3-8759-494ede34c0dc\") "
Jul 01 18:30:46.847343 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:46.847321    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee45e391-e73c-4dd3-8759-494ede34c0dc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ee45e391-e73c-4dd3-8759-494ede34c0dc" (UID: "ee45e391-e73c-4dd3-8759-494ede34c0dc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:30:46.848851 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:46.848826    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee45e391-e73c-4dd3-8759-494ede34c0dc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ee45e391-e73c-4dd3-8759-494ede34c0dc" (UID: "ee45e391-e73c-4dd3-8759-494ede34c0dc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:30:46.947493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:46.947448    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee45e391-e73c-4dd3-8759-494ede34c0dc-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:30:46.947493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:46.947468    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee45e391-e73c-4dd3-8759-494ede34c0dc-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:30:47.679497 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:47.679470    2567 generic.go:356] "Generic (PLEG): container finished" podID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerID="48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19" exitCode=0
Jul 01 18:30:47.679685 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:47.679514    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"
Jul 01 18:30:47.679685 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:47.679545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" event={"ID":"ee45e391-e73c-4dd3-8759-494ede34c0dc","Type":"ContainerDied","Data":"48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19"}
Jul 01 18:30:47.679685 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:47.679592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b" event={"ID":"ee45e391-e73c-4dd3-8759-494ede34c0dc","Type":"ContainerDied","Data":"4472d03cf9380e9d00aad48f29958f26abdea620ce3f52874abb5c99ff014878"}
Jul 01 18:30:47.679685 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:47.679612    2567 scope.go:117] "RemoveContainer" containerID="48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19"
Jul 01 18:30:47.687481 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:47.687464    2567 scope.go:117] "RemoveContainer" containerID="48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19"
Jul 01 18:30:47.687722 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:30:47.687705    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19\": container with ID starting with 48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19 not found: ID does not exist" containerID="48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19"
Jul 01 18:30:47.687777 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:47.687730    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19"} err="failed to get container status \"48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19\": rpc error: code = NotFound desc = could not find container \"48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19\": container with ID starting with 48542ce2143ff3f6f73298808cb2038ce483399cab47bfb350dd6dcc526f9a19 not found: ID does not exist"
Jul 01 18:30:47.696154 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:47.696134    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"]
Jul 01 18:30:47.699882 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:47.699866    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-2588a-79864c4578-t2p5b"]
Jul 01 18:30:49.427668 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:49.427640    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" path="/var/lib/kubelet/pods/ee45e391-e73c-4dd3-8759-494ede34c0dc/volumes"
Jul 01 18:30:53.557931 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:30:53.557894    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Jul 01 18:31:03.558391 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:03.558358    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:31:07.980652 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:07.980619    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:08.648105 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:08.648074    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:12.586793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.586766    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"]
Jul 01 18:31:12.587142 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.586955    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10" containerID="cri-o://e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba" gracePeriod=30
Jul 01 18:31:12.607844 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.607818    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:12.702846 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.702815    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"]
Jul 01 18:31:12.703055 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.703012    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container" containerID="cri-o://dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2" gracePeriod=30
Jul 01 18:31:12.703183 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.703065    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kube-rbac-proxy" containerID="cri-o://cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1" gracePeriod=30
Jul 01 18:31:12.729457 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.729434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:12.730446 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730429    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"]
Jul 01 18:31:12.730775 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730764    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a"
Jul 01 18:31:12.730811 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730777    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a"
Jul 01 18:31:12.730811 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730794    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kube-rbac-proxy"
Jul 01 18:31:12.730811 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730799    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kube-rbac-proxy"
Jul 01 18:31:12.730811 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730806    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container"
Jul 01 18:31:12.730811 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730811    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container"
Jul 01 18:31:12.730952 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730868    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee45e391-e73c-4dd3-8759-494ede34c0dc" containerName="switch-graph-2588a"
Jul 01 18:31:12.730952 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730877    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kube-rbac-proxy"
Jul 01 18:31:12.730952 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.730883    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63a87c1-08fd-4f19-8191-3f90d1eb4669" containerName="kserve-container"
Jul 01 18:31:12.734220 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.734204    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:12.736787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.736769    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9b590-predictor-serving-cert\""
Jul 01 18:31:12.736787 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.736786    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9b590-kube-rbac-proxy-sar-config\""
Jul 01 18:31:12.746396 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.746376    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"]
Jul 01 18:31:12.827059 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.827034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfbcn\" (UniqueName: \"kubernetes.io/projected/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-api-access-qfbcn\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:12.827171 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.827088    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-proxy-tls\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:12.827171 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.827110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:12.928352 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.928271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-proxy-tls\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:12.928352 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.928311    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:12.928551 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.928403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfbcn\" (UniqueName: \"kubernetes.io/projected/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-api-access-qfbcn\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:12.928551 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:31:12.928409    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-9b590-predictor-serving-cert: secret "success-200-isvc-9b590-predictor-serving-cert" not found
Jul 01 18:31:12.928551 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:31:12.928476    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-proxy-tls podName:756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6 nodeName:}" failed. No retries permitted until 2026-07-01 18:31:13.428455358 +0000 UTC m=+1482.658528170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-proxy-tls") pod "success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" (UID: "756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6") : secret "success-200-isvc-9b590-predictor-serving-cert" not found
Jul 01 18:31:12.929337 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.929309    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:12.938905 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.938872    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfbcn\" (UniqueName: \"kubernetes.io/projected/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-api-access-qfbcn\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:12.976701 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:12.976682    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:13.074349 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:13.074327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:13.280650 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:13.280629    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:13.431335 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:13.431306    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-proxy-tls\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:13.433493 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:13.433468    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-proxy-tls\") pod \"success-200-isvc-9b590-predictor-7674b6fd4d-hdktq\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") " pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:13.644485 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:13.644413    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:13.772046 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:13.772023    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"]
Jul 01 18:31:13.773888 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:31:13.773864    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756ceb0c_6b74_4ceb_b1a6_4461f1dd4cf6.slice/crio-621774e7526d704acffd46b62b9e965e5098c3409bc0cacf143f530ea25f30fd WatchSource:0}: Error finding container 621774e7526d704acffd46b62b9e965e5098c3409bc0cacf143f530ea25f30fd: Status 404 returned error can't find the container with id 621774e7526d704acffd46b62b9e965e5098c3409bc0cacf143f530ea25f30fd
Jul 01 18:31:13.798911 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:13.798881    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" event={"ID":"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6","Type":"ContainerStarted","Data":"621774e7526d704acffd46b62b9e965e5098c3409bc0cacf143f530ea25f30fd"}
Jul 01 18:31:13.800485 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:13.800462    2567 generic.go:356] "Generic (PLEG): container finished" podID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerID="cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1" exitCode=2
Jul 01 18:31:13.800587 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:13.800537    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" event={"ID":"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2","Type":"ContainerDied","Data":"cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1"}
Jul 01 18:31:14.638543 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:14.638510    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:14.806406 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:14.806375    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" event={"ID":"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6","Type":"ContainerStarted","Data":"b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b"}
Jul 01 18:31:14.806810 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:14.806447    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:14.806810 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:14.806479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" event={"ID":"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6","Type":"ContainerStarted","Data":"fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212"}
Jul 01 18:31:14.806810 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:14.806512    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:14.807831 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:14.807808    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Jul 01 18:31:14.823757 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:14.823715    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" podStartSLOduration=2.823701722 podStartE2EDuration="2.823701722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:31:14.822120211 +0000 UTC m=+1484.052193043" watchObservedRunningTime="2026-07-01 18:31:14.823701722 +0000 UTC m=+1484.053774553"
Jul 01 18:31:15.243905 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.243883    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:31:15.345558 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.345503    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-proxy-tls\") pod \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") "
Jul 01 18:31:15.345558 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.345531    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9w4m\" (UniqueName: \"kubernetes.io/projected/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-api-access-n9w4m\") pod \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") "
Jul 01 18:31:15.345695 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.345580    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-rbac-proxy-sar-config\") pod \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\" (UID: \"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2\") "
Jul 01 18:31:15.345908 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.345879    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" (UID: "2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:31:15.347427 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.347400    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" (UID: "2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:31:15.347427 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.347407    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-api-access-n9w4m" (OuterVolumeSpecName: "kube-api-access-n9w4m") pod "2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" (UID: "2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2"). InnerVolumeSpecName "kube-api-access-n9w4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:31:15.446216 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.446197    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:15.446310 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.446218    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9w4m\" (UniqueName: \"kubernetes.io/projected/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-api-access-n9w4m\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:15.446310 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.446227    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:15.812043 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.812015    2567 generic.go:356] "Generic (PLEG): container finished" podID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerID="dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2" exitCode=0
Jul 01 18:31:15.812443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.812073    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"
Jul 01 18:31:15.812443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.812084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" event={"ID":"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2","Type":"ContainerDied","Data":"dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2"}
Jul 01 18:31:15.812443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.812168    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf" event={"ID":"2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2","Type":"ContainerDied","Data":"9a60ff03d83ffc10f77df4bf6af4b044a1d9d0473ae7a4d44c75750cdcb7691a"}
Jul 01 18:31:15.812443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.812194    2567 scope.go:117] "RemoveContainer" containerID="cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1"
Jul 01 18:31:15.812642 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.812509    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Jul 01 18:31:15.820305 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.820289    2567 scope.go:117] "RemoveContainer" containerID="dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2"
Jul 01 18:31:15.828660 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.828600    2567 scope.go:117] "RemoveContainer" containerID="cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1"
Jul 01 18:31:15.828923 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:31:15.828897    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1\": container with ID starting with cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1 not found: ID does not exist" containerID="cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1"
Jul 01 18:31:15.829007 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.828932    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1"} err="failed to get container status \"cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1\": rpc error: code = NotFound desc = could not find container \"cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1\": container with ID starting with cbf9c0a0eb61e5e4134834b6366016565bd80fa6e351275f27fbb53b57df50d1 not found: ID does not exist"
Jul 01 18:31:15.829007 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.828954    2567 scope.go:117] "RemoveContainer" containerID="dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2"
Jul 01 18:31:15.829226 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:31:15.829205    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2\": container with ID starting with dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2 not found: ID does not exist" containerID="dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2"
Jul 01 18:31:15.829360 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.829233    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2"} err="failed to get container status \"dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2\": rpc error: code = NotFound desc = could not find container \"dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2\": container with ID starting with dff33e927c8c30b062cbcb33ea1427bb655c77759a970d380d8fcc8d2be888f2 not found: ID does not exist"
Jul 01 18:31:15.830473 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.830431    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"]
Jul 01 18:31:15.833589 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:15.833569    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c5c10-predictor-dfd5bc4db-rf4mf"]
Jul 01 18:31:16.891860 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.891835    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"]
Jul 01 18:31:16.892255 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.892207    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container"
Jul 01 18:31:16.892255 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.892219    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container"
Jul 01 18:31:16.892255 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.892229    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kube-rbac-proxy"
Jul 01 18:31:16.892255 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.892257    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kube-rbac-proxy"
Jul 01 18:31:16.892391 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.892322    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kube-rbac-proxy"
Jul 01 18:31:16.892391 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.892332    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" containerName="kserve-container"
Jul 01 18:31:16.893871 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.893849    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:16.896821 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.896804    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:16.899135 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.899116    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-0d3ed-kube-rbac-proxy-sar-config\""
Jul 01 18:31:16.899135 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.899123    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-0d3ed-serving-cert\""
Jul 01 18:31:16.902520 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.902503    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"]
Jul 01 18:31:16.955380 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.955359    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-proxy-tls\") pod \"ensemble-graph-0d3ed-65bff8cdd9-2vns6\" (UID: \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\") " pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:16.955463 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:16.955448    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-openshift-service-ca-bundle\") pod \"ensemble-graph-0d3ed-65bff8cdd9-2vns6\" (UID: \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\") " pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:17.056146 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:17.056104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-openshift-service-ca-bundle\") pod \"ensemble-graph-0d3ed-65bff8cdd9-2vns6\" (UID: \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\") " pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:17.056299 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:17.056193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-proxy-tls\") pod \"ensemble-graph-0d3ed-65bff8cdd9-2vns6\" (UID: \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\") " pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:17.056400 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:31:17.056342    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-0d3ed-serving-cert: secret "ensemble-graph-0d3ed-serving-cert" not found
Jul 01 18:31:17.056478 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:31:17.056413    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-proxy-tls podName:7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8 nodeName:}" failed. No retries permitted until 2026-07-01 18:31:17.556394649 +0000 UTC m=+1486.786467473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-proxy-tls") pod "ensemble-graph-0d3ed-65bff8cdd9-2vns6" (UID: "7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8") : secret "ensemble-graph-0d3ed-serving-cert" not found
Jul 01 18:31:17.056768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:17.056748    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-openshift-service-ca-bundle\") pod \"ensemble-graph-0d3ed-65bff8cdd9-2vns6\" (UID: \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\") " pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:17.189982 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:17.189926    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:17.427430 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:17.427408    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2" path="/var/lib/kubelet/pods/2f3f6391-8a2a-4d4c-8d28-ed8d9843d2b2/volumes"
Jul 01 18:31:17.558768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:17.558749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-proxy-tls\") pod \"ensemble-graph-0d3ed-65bff8cdd9-2vns6\" (UID: \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\") " pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:17.560821 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:17.560805    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-proxy-tls\") pod \"ensemble-graph-0d3ed-65bff8cdd9-2vns6\" (UID: \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\") " pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:17.808396 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:17.808375    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:17.930696 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:17.930670    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"]
Jul 01 18:31:17.932329 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:31:17.932302    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5fe37f_c403_4bb2_a3e0_23ad9c4173b8.slice/crio-6ece71df76af3098003e39407c04312c002f6cd1edb4c91a41e02c011bc17bf8 WatchSource:0}: Error finding container 6ece71df76af3098003e39407c04312c002f6cd1edb4c91a41e02c011bc17bf8: Status 404 returned error can't find the container with id 6ece71df76af3098003e39407c04312c002f6cd1edb4c91a41e02c011bc17bf8
Jul 01 18:31:18.830051 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:18.830021    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" event={"ID":"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8","Type":"ContainerStarted","Data":"ce75ddef11df96fce9b5af67a4fd3e4a1ae18c800252670e95b81c9526a4b5b0"}
Jul 01 18:31:18.830196 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:18.830166    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:18.830259 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:18.830201    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" event={"ID":"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8","Type":"ContainerStarted","Data":"6ece71df76af3098003e39407c04312c002f6cd1edb4c91a41e02c011bc17bf8"}
Jul 01 18:31:18.845480 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:18.845444    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" podStartSLOduration=2.8454319310000002 podStartE2EDuration="2.845431931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:31:18.844723007 +0000 UTC m=+1488.074795840" watchObservedRunningTime="2026-07-01 18:31:18.845431931 +0000 UTC m=+1488.075504762"
Jul 01 18:31:19.638515 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:19.638484    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:20.817814 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:20.817787    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:31:20.818196 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:20.818148    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Jul 01 18:31:24.638984 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:24.638949    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:24.639333 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:24.639039    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:31:24.840469 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:24.840441    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:26.969902 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:26.969828    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"]
Jul 01 18:31:26.970309 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:26.970003    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed" containerID="cri-o://ce75ddef11df96fce9b5af67a4fd3e4a1ae18c800252670e95b81c9526a4b5b0" gracePeriod=30
Jul 01 18:31:26.993078 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:26.993056    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:27.083179 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.083153    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:27.106135 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.105664    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"]
Jul 01 18:31:27.106135 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.105954    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container" containerID="cri-o://5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce" gracePeriod=30
Jul 01 18:31:27.106135 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.106010    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kube-rbac-proxy" containerID="cri-o://ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525" gracePeriod=30
Jul 01 18:31:27.121533 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.121511    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"]
Jul 01 18:31:27.126169 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.126153    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.129621 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.129598    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c1eb4-kube-rbac-proxy-sar-config\""
Jul 01 18:31:27.129722 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.129637    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c1eb4-predictor-serving-cert\""
Jul 01 18:31:27.135191 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.135170    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"]
Jul 01 18:31:27.182816 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.182791    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:27.226138 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.226116    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") " pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.226330 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.226191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26x2q\" (UniqueName: \"kubernetes.io/projected/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-api-access-26x2q\") pod \"success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") " pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.226330 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.226299    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a64ad961-1fb4-468f-9acc-4e72cc202d9a-proxy-tls\") pod \"success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") " pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.272033 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.272005    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:27.326894 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.326868    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a64ad961-1fb4-468f-9acc-4e72cc202d9a-proxy-tls\") pod \"success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") " pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.327024 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.326922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") " pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.327024 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.327004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26x2q\" (UniqueName: \"kubernetes.io/projected/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-api-access-26x2q\") pod \"success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") " pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.327760 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.327741    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") " pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.329266 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.329219    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a64ad961-1fb4-468f-9acc-4e72cc202d9a-proxy-tls\") pod \"success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") " pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.339155 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.339136    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26x2q\" (UniqueName: \"kubernetes.io/projected/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-api-access-26x2q\") pod \"success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") " pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.347378 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.347360    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:27.438230 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.438196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.460673 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.460649    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:31:27.565842 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.565818    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"]
Jul 01 18:31:27.567402 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:31:27.567380    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64ad961_1fb4_468f_9acc_4e72cc202d9a.slice/crio-58a4d254a27c5af91098767f9951bbdfb47f11c7f18b379745989d85b296bbfc WatchSource:0}: Error finding container 58a4d254a27c5af91098767f9951bbdfb47f11c7f18b379745989d85b296bbfc: Status 404 returned error can't find the container with id 58a4d254a27c5af91098767f9951bbdfb47f11c7f18b379745989d85b296bbfc
Jul 01 18:31:27.872631 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.872603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" event={"ID":"a64ad961-1fb4-468f-9acc-4e72cc202d9a","Type":"ContainerStarted","Data":"b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901"}
Jul 01 18:31:27.872806 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.872663    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.872806 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.872689    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" event={"ID":"a64ad961-1fb4-468f-9acc-4e72cc202d9a","Type":"ContainerStarted","Data":"86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b"}
Jul 01 18:31:27.872806 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.872715    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:27.872806 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.872733    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" event={"ID":"a64ad961-1fb4-468f-9acc-4e72cc202d9a","Type":"ContainerStarted","Data":"58a4d254a27c5af91098767f9951bbdfb47f11c7f18b379745989d85b296bbfc"}
Jul 01 18:31:27.874379 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.874354    2567 generic.go:356] "Generic (PLEG): container finished" podID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerID="ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525" exitCode=2
Jul 01 18:31:27.874483 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.874407    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" event={"ID":"d720426e-8bce-4003-bc5a-36fa7a4a3349","Type":"ContainerDied","Data":"ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525"}
Jul 01 18:31:27.874541 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.874490    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Jul 01 18:31:27.890140 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:27.890102    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podStartSLOduration=0.890089777 podStartE2EDuration="890.089777ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:31:27.887824628 +0000 UTC m=+1497.117897459" watchObservedRunningTime="2026-07-01 18:31:27.890089777 +0000 UTC m=+1497.120162663"
Jul 01 18:31:28.554353 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:28.554319    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.43:8643/healthz\": dial tcp 10.134.0.43:8643: connect: connection refused"
Jul 01 18:31:28.879260 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:28.879151    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Jul 01 18:31:29.639176 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.639143    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:29.750512 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.750491    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:31:29.839188 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.839126    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:29.848694 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.848665    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d720426e-8bce-4003-bc5a-36fa7a4a3349-proxy-tls\") pod \"d720426e-8bce-4003-bc5a-36fa7a4a3349\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") "
Jul 01 18:31:29.848776 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.848709    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtnk9\" (UniqueName: \"kubernetes.io/projected/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-api-access-dtnk9\") pod \"d720426e-8bce-4003-bc5a-36fa7a4a3349\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") "
Jul 01 18:31:29.848776 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.848736    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-rbac-proxy-sar-config\") pod \"d720426e-8bce-4003-bc5a-36fa7a4a3349\" (UID: \"d720426e-8bce-4003-bc5a-36fa7a4a3349\") "
Jul 01 18:31:29.849103 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.849078    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d720426e-8bce-4003-bc5a-36fa7a4a3349" (UID: "d720426e-8bce-4003-bc5a-36fa7a4a3349"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:31:29.850600 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.850579    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-api-access-dtnk9" (OuterVolumeSpecName: "kube-api-access-dtnk9") pod "d720426e-8bce-4003-bc5a-36fa7a4a3349" (UID: "d720426e-8bce-4003-bc5a-36fa7a4a3349"). InnerVolumeSpecName "kube-api-access-dtnk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:31:29.850680 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.850627    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d720426e-8bce-4003-bc5a-36fa7a4a3349-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d720426e-8bce-4003-bc5a-36fa7a4a3349" (UID: "d720426e-8bce-4003-bc5a-36fa7a4a3349"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:31:29.885007 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.884988    2567 generic.go:356] "Generic (PLEG): container finished" podID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerID="5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce" exitCode=0
Jul 01 18:31:29.885095 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.885035    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"
Jul 01 18:31:29.885095 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.885048    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" event={"ID":"d720426e-8bce-4003-bc5a-36fa7a4a3349","Type":"ContainerDied","Data":"5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce"}
Jul 01 18:31:29.885160 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.885128    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6" event={"ID":"d720426e-8bce-4003-bc5a-36fa7a4a3349","Type":"ContainerDied","Data":"c6b2f54138db3c143ddcfe606bcd9ef0b1ff8d1c490a31eca402e184f5b4cd1c"}
Jul 01 18:31:29.885160 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.885155    2567 scope.go:117] "RemoveContainer" containerID="ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525"
Jul 01 18:31:29.893345 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.893329    2567 scope.go:117] "RemoveContainer" containerID="5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce"
Jul 01 18:31:29.900481 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.900462    2567 scope.go:117] "RemoveContainer" containerID="ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525"
Jul 01 18:31:29.900720 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:31:29.900705    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525\": container with ID starting with ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525 not found: ID does not exist" containerID="ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525"
Jul 01 18:31:29.900768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.900727    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525"} err="failed to get container status \"ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525\": rpc error: code = NotFound desc = could not find container \"ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525\": container with ID starting with ef3871bc0dbb432042e45194fe9b44cb868678eda57dcb08f0d632cf48879525 not found: ID does not exist"
Jul 01 18:31:29.900768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.900742    2567 scope.go:117] "RemoveContainer" containerID="5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce"
Jul 01 18:31:29.900941 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:31:29.900928    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce\": container with ID starting with 5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce not found: ID does not exist" containerID="5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce"
Jul 01 18:31:29.900972 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.900944    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce"} err="failed to get container status \"5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce\": rpc error: code = NotFound desc = could not find container \"5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce\": container with ID starting with 5f40d42f3c62775f9abd326d494d88fc2567e6738d54110c0bf98ed1dc69f2ce not found: ID does not exist"
Jul 01 18:31:29.907919 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.907899    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"]
Jul 01 18:31:29.912408 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.912390    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0d3ed-predictor-65947cd9b6-48tp6"]
Jul 01 18:31:29.950086 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.950066    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d720426e-8bce-4003-bc5a-36fa7a4a3349-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:29.950086 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.950084    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtnk9\" (UniqueName: \"kubernetes.io/projected/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-api-access-dtnk9\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:29.950195 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:29.950092    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d720426e-8bce-4003-bc5a-36fa7a4a3349-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:30.819001 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:30.818971    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Jul 01 18:31:31.428847 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:31.428816    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" path="/var/lib/kubelet/pods/d720426e-8bce-4003-bc5a-36fa7a4a3349/volumes"
Jul 01 18:31:31.563657 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:31.563638    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:31:31.564500 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:31.564478    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:31:31.569127 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:31.569108    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:31:31.570277 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:31.570261    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:31:33.883769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:33.883742    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:31:33.884137 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:33.884112    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Jul 01 18:31:34.638755 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:34.638725    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:34.839759 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:34.839726    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:39.638112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:39.638078    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:39.839880 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:39.839849    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:39.840112 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:39.839932    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:40.818371 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:40.818335    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Jul 01 18:31:42.742350 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.742329    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:31:42.851583 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.851520    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1901c013-03ed-4930-adf2-b88b17961d79-openshift-service-ca-bundle\") pod \"1901c013-03ed-4930-adf2-b88b17961d79\" (UID: \"1901c013-03ed-4930-adf2-b88b17961d79\") "
Jul 01 18:31:42.851583 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.851557    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1901c013-03ed-4930-adf2-b88b17961d79-proxy-tls\") pod \"1901c013-03ed-4930-adf2-b88b17961d79\" (UID: \"1901c013-03ed-4930-adf2-b88b17961d79\") "
Jul 01 18:31:42.851899 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.851871    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1901c013-03ed-4930-adf2-b88b17961d79-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "1901c013-03ed-4930-adf2-b88b17961d79" (UID: "1901c013-03ed-4930-adf2-b88b17961d79"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:31:42.853427 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.853410    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1901c013-03ed-4930-adf2-b88b17961d79-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1901c013-03ed-4930-adf2-b88b17961d79" (UID: "1901c013-03ed-4930-adf2-b88b17961d79"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:31:42.948498 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.948473    2567 generic.go:356] "Generic (PLEG): container finished" podID="1901c013-03ed-4930-adf2-b88b17961d79" containerID="e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba" exitCode=0
Jul 01 18:31:42.948596 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.948510    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"
Jul 01 18:31:42.948596 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.948553    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" event={"ID":"1901c013-03ed-4930-adf2-b88b17961d79","Type":"ContainerDied","Data":"e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba"}
Jul 01 18:31:42.948689 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.948600    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6" event={"ID":"1901c013-03ed-4930-adf2-b88b17961d79","Type":"ContainerDied","Data":"6f69566cdf9292e5ea0517cd2a96ae811822c77b781fcf88376dcaefd80f022a"}
Jul 01 18:31:42.948689 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.948622    2567 scope.go:117] "RemoveContainer" containerID="e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba"
Jul 01 18:31:42.952165 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.952142    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1901c013-03ed-4930-adf2-b88b17961d79-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:42.952269 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.952168    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1901c013-03ed-4930-adf2-b88b17961d79-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:42.956781 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.956767    2567 scope.go:117] "RemoveContainer" containerID="e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba"
Jul 01 18:31:42.957005 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:31:42.956986    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba\": container with ID starting with e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba not found: ID does not exist" containerID="e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba"
Jul 01 18:31:42.957064 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.957016    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba"} err="failed to get container status \"e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba\": rpc error: code = NotFound desc = could not find container \"e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba\": container with ID starting with e66b2213c9024d72bcf773a58eb461acd94cebca7bd004595e83d85368718bba not found: ID does not exist"
Jul 01 18:31:42.968220 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.968202    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"]
Jul 01 18:31:42.971667 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:42.971649    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-c5c10-7b978df757-rw5r6"]
Jul 01 18:31:43.426674 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:43.426646    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1901c013-03ed-4930-adf2-b88b17961d79" path="/var/lib/kubelet/pods/1901c013-03ed-4930-adf2-b88b17961d79/volumes"
Jul 01 18:31:43.884331 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:43.884297    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Jul 01 18:31:44.839093 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:44.839051    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:49.839176 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:49.839140    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:50.819150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:50.819117    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Jul 01 18:31:53.884815 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:53.884738    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Jul 01 18:31:54.839151 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:54.839117    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:31:57.015586 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:57.015562    2567 generic.go:356] "Generic (PLEG): container finished" podID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerID="ce75ddef11df96fce9b5af67a4fd3e4a1ae18c800252670e95b81c9526a4b5b0" exitCode=0
Jul 01 18:31:57.015870 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:57.015639    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" event={"ID":"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8","Type":"ContainerDied","Data":"ce75ddef11df96fce9b5af67a4fd3e4a1ae18c800252670e95b81c9526a4b5b0"}
Jul 01 18:31:57.612386 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:57.612321    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:57.753511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:57.753438    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-proxy-tls\") pod \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\" (UID: \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\") "
Jul 01 18:31:57.753511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:57.753508    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-openshift-service-ca-bundle\") pod \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\" (UID: \"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8\") "
Jul 01 18:31:57.753803 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:57.753781    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" (UID: "7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:31:57.755258 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:57.755216    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" (UID: "7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:31:57.854699 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:57.854675    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:57.854699 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:57.854700    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:31:58.021585 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:58.021536    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"
Jul 01 18:31:58.021585 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:58.021566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6" event={"ID":"7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8","Type":"ContainerDied","Data":"6ece71df76af3098003e39407c04312c002f6cd1edb4c91a41e02c011bc17bf8"}
Jul 01 18:31:58.021914 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:58.021625    2567 scope.go:117] "RemoveContainer" containerID="ce75ddef11df96fce9b5af67a4fd3e4a1ae18c800252670e95b81c9526a4b5b0"
Jul 01 18:31:58.041716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:58.041694    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"]
Jul 01 18:31:58.045407 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:58.045390    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-0d3ed-65bff8cdd9-2vns6"]
Jul 01 18:31:59.427686 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:31:59.427651    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" path="/var/lib/kubelet/pods/7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8/volumes"
Jul 01 18:32:00.819789 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:00.819758    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:32:03.884884 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:03.884849    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Jul 01 18:32:12.754804 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.754771    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"]
Jul 01 18:32:12.755285 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755271    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10"
Jul 01 18:32:12.755340 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755288    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10"
Jul 01 18:32:12.755340 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755323    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed"
Jul 01 18:32:12.755411 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755341    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed"
Jul 01 18:32:12.755411 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755358    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container"
Jul 01 18:32:12.755411 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755366    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container"
Jul 01 18:32:12.755411 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755376    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kube-rbac-proxy"
Jul 01 18:32:12.755411 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755383    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kube-rbac-proxy"
Jul 01 18:32:12.755553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755452    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1901c013-03ed-4930-adf2-b88b17961d79" containerName="sequence-graph-c5c10"
Jul 01 18:32:12.755553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755464    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kserve-container"
Jul 01 18:32:12.755553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755480    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d5fe37f-c403-4bb2-a3e0-23ad9c4173b8" containerName="ensemble-graph-0d3ed"
Jul 01 18:32:12.755553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.755490    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d720426e-8bce-4003-bc5a-36fa7a4a3349" containerName="kube-rbac-proxy"
Jul 01 18:32:12.757117 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.757089    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:32:12.758631 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.758616    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:12.760939 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.760920    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-9b590-serving-cert\""
Jul 01 18:32:12.761062 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.760986    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-9b590-kube-rbac-proxy-sar-config\""
Jul 01 18:32:12.770021 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.770001    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"]
Jul 01 18:32:12.865406 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.865386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/361eeffa-efd3-4930-a1c5-95ffb0f1f948-proxy-tls\") pod \"sequence-graph-9b590-78448686f8-prj8j\" (UID: \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\") " pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:12.865504 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.865426    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/361eeffa-efd3-4930-a1c5-95ffb0f1f948-openshift-service-ca-bundle\") pod \"sequence-graph-9b590-78448686f8-prj8j\" (UID: \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\") " pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:12.966017 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.965997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/361eeffa-efd3-4930-a1c5-95ffb0f1f948-proxy-tls\") pod \"sequence-graph-9b590-78448686f8-prj8j\" (UID: \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\") " pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:12.966111 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.966029    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/361eeffa-efd3-4930-a1c5-95ffb0f1f948-openshift-service-ca-bundle\") pod \"sequence-graph-9b590-78448686f8-prj8j\" (UID: \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\") " pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:12.966158 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:32:12.966141    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-9b590-serving-cert: secret "sequence-graph-9b590-serving-cert" not found
Jul 01 18:32:12.966201 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:32:12.966194    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361eeffa-efd3-4930-a1c5-95ffb0f1f948-proxy-tls podName:361eeffa-efd3-4930-a1c5-95ffb0f1f948 nodeName:}" failed. No retries permitted until 2026-07-01 18:32:13.466178985 +0000 UTC m=+1542.696251795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/361eeffa-efd3-4930-a1c5-95ffb0f1f948-proxy-tls") pod "sequence-graph-9b590-78448686f8-prj8j" (UID: "361eeffa-efd3-4930-a1c5-95ffb0f1f948") : secret "sequence-graph-9b590-serving-cert" not found
Jul 01 18:32:12.966545 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:12.966530    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/361eeffa-efd3-4930-a1c5-95ffb0f1f948-openshift-service-ca-bundle\") pod \"sequence-graph-9b590-78448686f8-prj8j\" (UID: \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\") " pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:13.307154 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:13.307129    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:32:13.469938 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:13.469922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/361eeffa-efd3-4930-a1c5-95ffb0f1f948-proxy-tls\") pod \"sequence-graph-9b590-78448686f8-prj8j\" (UID: \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\") " pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:13.472015 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:13.471989    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/361eeffa-efd3-4930-a1c5-95ffb0f1f948-proxy-tls\") pod \"sequence-graph-9b590-78448686f8-prj8j\" (UID: \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\") " pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:13.668318 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:13.668269    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:13.787152 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:13.787133    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"]
Jul 01 18:32:13.789348 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:32:13.789317    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361eeffa_efd3_4930_a1c5_95ffb0f1f948.slice/crio-738bd0f39ce3edf258a38a0c182ad94f16a954186f22615bc013bd259aa0155a WatchSource:0}: Error finding container 738bd0f39ce3edf258a38a0c182ad94f16a954186f22615bc013bd259aa0155a: Status 404 returned error can't find the container with id 738bd0f39ce3edf258a38a0c182ad94f16a954186f22615bc013bd259aa0155a
Jul 01 18:32:13.885282 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:13.885263    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:32:14.091069 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:14.091046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" event={"ID":"361eeffa-efd3-4930-a1c5-95ffb0f1f948","Type":"ContainerStarted","Data":"7d54c26e62f799f7e96a4cfe46e13e8a31012696ea08c6cbe4d2fe64f5fbe856"}
Jul 01 18:32:14.091211 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:14.091089    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" event={"ID":"361eeffa-efd3-4930-a1c5-95ffb0f1f948","Type":"ContainerStarted","Data":"738bd0f39ce3edf258a38a0c182ad94f16a954186f22615bc013bd259aa0155a"}
Jul 01 18:32:14.091211 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:14.091142    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:14.106734 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:14.106690    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" podStartSLOduration=2.106676792 podStartE2EDuration="2.106676792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:14.106152147 +0000 UTC m=+1543.336224978" watchObservedRunningTime="2026-07-01 18:32:14.106676792 +0000 UTC m=+1543.336749623"
Jul 01 18:32:18.592983 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:18.592949    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:32:20.100412 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:20.100389    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:22.828363 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.828335    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"]
Jul 01 18:32:22.828728 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.828550    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590" containerID="cri-o://7d54c26e62f799f7e96a4cfe46e13e8a31012696ea08c6cbe4d2fe64f5fbe856" gracePeriod=30
Jul 01 18:32:22.854470 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.854444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:32:22.979828 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.979798    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"]
Jul 01 18:32:22.983492 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.983470    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"]
Jul 01 18:32:22.983762 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.983693    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container" containerID="cri-o://fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212" gracePeriod=30
Jul 01 18:32:22.983870 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.983719    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kube-rbac-proxy" containerID="cri-o://b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b" gracePeriod=30
Jul 01 18:32:22.983870 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.983806    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:22.986092 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.986068    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-293b3-predictor-serving-cert\""
Jul 01 18:32:22.986188 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.986069    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-293b3-kube-rbac-proxy-sar-config\""
Jul 01 18:32:22.995739 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:22.995718    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"]
Jul 01 18:32:23.038201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.038173    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7962bc6c-a206-4599-a2da-a43cc1669814-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-293b3-predictor-67c5856c84-z6lcg\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") " pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.038343 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.038214    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklh9\" (UniqueName: \"kubernetes.io/projected/7962bc6c-a206-4599-a2da-a43cc1669814-kube-api-access-vklh9\") pod \"success-200-isvc-293b3-predictor-67c5856c84-z6lcg\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") " pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.038343 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.038262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7962bc6c-a206-4599-a2da-a43cc1669814-proxy-tls\") pod \"success-200-isvc-293b3-predictor-67c5856c84-z6lcg\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") " pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.130157 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.130126    2567 generic.go:356] "Generic (PLEG): container finished" podID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerID="b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b" exitCode=2
Jul 01 18:32:23.130275 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.130193    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" event={"ID":"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6","Type":"ContainerDied","Data":"b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b"}
Jul 01 18:32:23.139672 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.139653    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7962bc6c-a206-4599-a2da-a43cc1669814-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-293b3-predictor-67c5856c84-z6lcg\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") " pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.139779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.139682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklh9\" (UniqueName: \"kubernetes.io/projected/7962bc6c-a206-4599-a2da-a43cc1669814-kube-api-access-vklh9\") pod \"success-200-isvc-293b3-predictor-67c5856c84-z6lcg\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") " pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.139779 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.139700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7962bc6c-a206-4599-a2da-a43cc1669814-proxy-tls\") pod \"success-200-isvc-293b3-predictor-67c5856c84-z6lcg\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") " pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.140438 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.140421    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7962bc6c-a206-4599-a2da-a43cc1669814-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-293b3-predictor-67c5856c84-z6lcg\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") " pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.141832 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.141810    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7962bc6c-a206-4599-a2da-a43cc1669814-proxy-tls\") pod \"success-200-isvc-293b3-predictor-67c5856c84-z6lcg\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") " pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.150754 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.150737    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklh9\" (UniqueName: \"kubernetes.io/projected/7962bc6c-a206-4599-a2da-a43cc1669814-kube-api-access-vklh9\") pod \"success-200-isvc-293b3-predictor-67c5856c84-z6lcg\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") " pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.303335 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.303308    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:23.330034 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.330003    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:32:23.402159 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.402137    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:32:23.427174 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:23.427151    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"]
Jul 01 18:32:23.428773 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:32:23.428751    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7962bc6c_a206_4599_a2da_a43cc1669814.slice/crio-cceb25339f21ee0cbbc6315546fd951ea3619d181980449937a9067ab94eb179 WatchSource:0}: Error finding container cceb25339f21ee0cbbc6315546fd951ea3619d181980449937a9067ab94eb179: Status 404 returned error can't find the container with id cceb25339f21ee0cbbc6315546fd951ea3619d181980449937a9067ab94eb179
Jul 01 18:32:24.137408 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:24.137364    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" event={"ID":"7962bc6c-a206-4599-a2da-a43cc1669814","Type":"ContainerStarted","Data":"750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3"}
Jul 01 18:32:24.137763 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:24.137440    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" event={"ID":"7962bc6c-a206-4599-a2da-a43cc1669814","Type":"ContainerStarted","Data":"3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47"}
Jul 01 18:32:24.137763 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:24.137471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" event={"ID":"7962bc6c-a206-4599-a2da-a43cc1669814","Type":"ContainerStarted","Data":"cceb25339f21ee0cbbc6315546fd951ea3619d181980449937a9067ab94eb179"}
Jul 01 18:32:24.137763 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:24.137501    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:24.137763 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:24.137529    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:24.138795 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:24.138768    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.48:8080: connect: connection refused"
Jul 01 18:32:24.156523 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:24.156480    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podStartSLOduration=2.156467064 podStartE2EDuration="2.156467064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:24.154607546 +0000 UTC m=+1553.384680406" watchObservedRunningTime="2026-07-01 18:32:24.156467064 +0000 UTC m=+1553.386539896"
Jul 01 18:32:25.100165 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.100130    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:32:25.142592 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.142552    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.48:8080: connect: connection refused"
Jul 01 18:32:25.519090 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.519068    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:32:25.561346 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.561324    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-rbac-proxy-sar-config\") pod \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") "
Jul 01 18:32:25.561453 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.561390    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-proxy-tls\") pod \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") "
Jul 01 18:32:25.561453 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.561411    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfbcn\" (UniqueName: \"kubernetes.io/projected/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-api-access-qfbcn\") pod \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\" (UID: \"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6\") "
Jul 01 18:32:25.561714 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.561683    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" (UID: "756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:32:25.563360 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.563334    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-api-access-qfbcn" (OuterVolumeSpecName: "kube-api-access-qfbcn") pod "756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" (UID: "756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6"). InnerVolumeSpecName "kube-api-access-qfbcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:32:25.563433 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.563367    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" (UID: "756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:32:25.662916 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.662864    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:32:25.662916 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.662885    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfbcn\" (UniqueName: \"kubernetes.io/projected/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-api-access-qfbcn\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:32:25.662916 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:25.662894    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:32:26.148640 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.148607    2567 generic.go:356] "Generic (PLEG): container finished" podID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerID="fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212" exitCode=0
Jul 01 18:32:26.148946 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.148674    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"
Jul 01 18:32:26.148946 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.148667    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" event={"ID":"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6","Type":"ContainerDied","Data":"fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212"}
Jul 01 18:32:26.148946 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.148819    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq" event={"ID":"756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6","Type":"ContainerDied","Data":"621774e7526d704acffd46b62b9e965e5098c3409bc0cacf143f530ea25f30fd"}
Jul 01 18:32:26.148946 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.148844    2567 scope.go:117] "RemoveContainer" containerID="b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b"
Jul 01 18:32:26.156969 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.156955    2567 scope.go:117] "RemoveContainer" containerID="fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212"
Jul 01 18:32:26.163955 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.163939    2567 scope.go:117] "RemoveContainer" containerID="b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b"
Jul 01 18:32:26.164202 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:32:26.164185    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b\": container with ID starting with b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b not found: ID does not exist" containerID="b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b"
Jul 01 18:32:26.164317 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.164210    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b"} err="failed to get container status \"b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b\": rpc error: code = NotFound desc = could not find container \"b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b\": container with ID starting with b0dae9574f9d3d0ccd05f96d3cf415c84a928d5011615476c03ecf82ff5a8d3b not found: ID does not exist"
Jul 01 18:32:26.164317 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.164225    2567 scope.go:117] "RemoveContainer" containerID="fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212"
Jul 01 18:32:26.164474 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:32:26.164458    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212\": container with ID starting with fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212 not found: ID does not exist" containerID="fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212"
Jul 01 18:32:26.164516 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.164479    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212"} err="failed to get container status \"fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212\": rpc error: code = NotFound desc = could not find container \"fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212\": container with ID starting with fc0e513ff2500be4785dd1cc5fe1c4b826fbc6de277645b6af8f49f6f06bc212 not found: ID does not exist"
Jul 01 18:32:26.169945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.169928    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"]
Jul 01 18:32:26.173425 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:26.173407    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9b590-predictor-7674b6fd4d-hdktq"]
Jul 01 18:32:27.180277 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.180232    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"]
Jul 01 18:32:27.180633 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.180619    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container"
Jul 01 18:32:27.180675 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.180634    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container"
Jul 01 18:32:27.180675 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.180649    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kube-rbac-proxy"
Jul 01 18:32:27.180675 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.180654    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kube-rbac-proxy"
Jul 01 18:32:27.180767 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.180708    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kserve-container"
Jul 01 18:32:27.180767 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.180719    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" containerName="kube-rbac-proxy"
Jul 01 18:32:27.184867 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.184849    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:27.185693 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.185671    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:32:27.187068 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.187052    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c1eb4-kube-rbac-proxy-sar-config\""
Jul 01 18:32:27.187407 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.187389    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c1eb4-serving-cert\""
Jul 01 18:32:27.190584 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.190564    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"]
Jul 01 18:32:27.276081 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.276057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-openshift-service-ca-bundle\") pod \"ensemble-graph-c1eb4-59675ff8b-b6nwr\" (UID: \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\") " pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:27.276211 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.276088    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-proxy-tls\") pod \"ensemble-graph-c1eb4-59675ff8b-b6nwr\" (UID: \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\") " pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:27.376710 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.376687    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-openshift-service-ca-bundle\") pod \"ensemble-graph-c1eb4-59675ff8b-b6nwr\" (UID: \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\") " pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:27.376819 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.376723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-proxy-tls\") pod \"ensemble-graph-c1eb4-59675ff8b-b6nwr\" (UID: \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\") " pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:27.376927 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:32:27.376908    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-c1eb4-serving-cert: secret "ensemble-graph-c1eb4-serving-cert" not found
Jul 01 18:32:27.376988 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:32:27.376978    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-proxy-tls podName:6df8fd9e-778f-4602-b75d-cc1436c7a0a4 nodeName:}" failed. No retries permitted until 2026-07-01 18:32:27.876957684 +0000 UTC m=+1557.107030500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-proxy-tls") pod "ensemble-graph-c1eb4-59675ff8b-b6nwr" (UID: "6df8fd9e-778f-4602-b75d-cc1436c7a0a4") : secret "ensemble-graph-c1eb4-serving-cert" not found
Jul 01 18:32:27.377224 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.377209    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-openshift-service-ca-bundle\") pod \"ensemble-graph-c1eb4-59675ff8b-b6nwr\" (UID: \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\") " pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:27.428032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.428000    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6" path="/var/lib/kubelet/pods/756ceb0c-6b74-4ceb-b1a6-4461f1dd4cf6/volumes"
Jul 01 18:32:27.503806 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.503756    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:32:27.881860 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.881823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-proxy-tls\") pod \"ensemble-graph-c1eb4-59675ff8b-b6nwr\" (UID: \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\") " pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:27.883898 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:27.883881    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-proxy-tls\") pod \"ensemble-graph-c1eb4-59675ff8b-b6nwr\" (UID: \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\") " pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:28.096906 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:28.096878    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:28.220557 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:28.220533    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"]
Jul 01 18:32:28.222503 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:32:28.222478    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df8fd9e_778f_4602_b75d_cc1436c7a0a4.slice/crio-de0e0439cb8c98d4c5c2c4c29385c57930696f366fdee832698beedd40cdb453 WatchSource:0}: Error finding container de0e0439cb8c98d4c5c2c4c29385c57930696f366fdee832698beedd40cdb453: Status 404 returned error can't find the container with id de0e0439cb8c98d4c5c2c4c29385c57930696f366fdee832698beedd40cdb453
Jul 01 18:32:29.167527 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:29.167493    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" event={"ID":"6df8fd9e-778f-4602-b75d-cc1436c7a0a4","Type":"ContainerStarted","Data":"c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c"}
Jul 01 18:32:29.167659 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:29.167550    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:29.167659 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:29.167574    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" event={"ID":"6df8fd9e-778f-4602-b75d-cc1436c7a0a4","Type":"ContainerStarted","Data":"de0e0439cb8c98d4c5c2c4c29385c57930696f366fdee832698beedd40cdb453"}
Jul 01 18:32:29.184465 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:29.184417    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" podStartSLOduration=2.184404315 podStartE2EDuration="2.184404315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:29.183060548 +0000 UTC m=+1558.413133380" watchObservedRunningTime="2026-07-01 18:32:29.184404315 +0000 UTC m=+1558.414477174"
Jul 01 18:32:30.098860 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:30.098815    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:32:30.146837 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:30.146814    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:32:30.147276 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:30.147223    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.48:8080: connect: connection refused"
Jul 01 18:32:35.099216 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:35.099180    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:32:35.099652 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:35.099299    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:35.178344 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:35.178311    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:32:40.099068 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:40.099033    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:32:40.147450 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:40.147419    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.48:8080: connect: connection refused"
Jul 01 18:32:45.098824 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:45.098784    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:32:50.098759 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:50.098719    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:32:50.147675 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:50.147648    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.48:8080: connect: connection refused"
Jul 01 18:32:53.275297 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:53.275202    2567 generic.go:356] "Generic (PLEG): container finished" podID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerID="7d54c26e62f799f7e96a4cfe46e13e8a31012696ea08c6cbe4d2fe64f5fbe856" exitCode=137
Jul 01 18:32:53.275297 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:53.275277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" event={"ID":"361eeffa-efd3-4930-a1c5-95ffb0f1f948","Type":"ContainerDied","Data":"7d54c26e62f799f7e96a4cfe46e13e8a31012696ea08c6cbe4d2fe64f5fbe856"}
Jul 01 18:32:53.475458 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:53.475439    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:53.576643 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:53.576621    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/361eeffa-efd3-4930-a1c5-95ffb0f1f948-proxy-tls\") pod \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\" (UID: \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\") "
Jul 01 18:32:53.576750 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:53.576681    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/361eeffa-efd3-4930-a1c5-95ffb0f1f948-openshift-service-ca-bundle\") pod \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\" (UID: \"361eeffa-efd3-4930-a1c5-95ffb0f1f948\") "
Jul 01 18:32:53.576999 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:53.576979    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361eeffa-efd3-4930-a1c5-95ffb0f1f948-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "361eeffa-efd3-4930-a1c5-95ffb0f1f948" (UID: "361eeffa-efd3-4930-a1c5-95ffb0f1f948"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:32:53.578596 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:53.578577    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/361eeffa-efd3-4930-a1c5-95ffb0f1f948-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "361eeffa-efd3-4930-a1c5-95ffb0f1f948" (UID: "361eeffa-efd3-4930-a1c5-95ffb0f1f948"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:32:53.677181 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:53.677165    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/361eeffa-efd3-4930-a1c5-95ffb0f1f948-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:32:53.677288 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:53.677183    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/361eeffa-efd3-4930-a1c5-95ffb0f1f948-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:32:54.280334 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:54.280310    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"
Jul 01 18:32:54.280768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:54.280338    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j" event={"ID":"361eeffa-efd3-4930-a1c5-95ffb0f1f948","Type":"ContainerDied","Data":"738bd0f39ce3edf258a38a0c182ad94f16a954186f22615bc013bd259aa0155a"}
Jul 01 18:32:54.280768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:54.280387    2567 scope.go:117] "RemoveContainer" containerID="7d54c26e62f799f7e96a4cfe46e13e8a31012696ea08c6cbe4d2fe64f5fbe856"
Jul 01 18:32:54.311827 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:54.311803    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"]
Jul 01 18:32:54.316575 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:54.316557    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-9b590-78448686f8-prj8j"]
Jul 01 18:32:55.426781 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:32:55.426752    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" path="/var/lib/kubelet/pods/361eeffa-efd3-4930-a1c5-95ffb0f1f948/volumes"
Jul 01 18:33:00.147462 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:00.147428    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.48:8080: connect: connection refused"
Jul 01 18:33:10.149018 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:10.148983    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:33:23.045373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.045291    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"]
Jul 01 18:33:23.045905 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.045829    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590"
Jul 01 18:33:23.045905 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.045847    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590"
Jul 01 18:33:23.046025 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.045974    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="361eeffa-efd3-4930-a1c5-95ffb0f1f948" containerName="sequence-graph-9b590"
Jul 01 18:33:23.047508 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.047483    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:33:23.049032 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.049016    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:23.051499 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.051479    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-293b3-serving-cert\""
Jul 01 18:33:23.051499 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.051491    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-293b3-kube-rbac-proxy-sar-config\""
Jul 01 18:33:23.057863 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.057840    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"]
Jul 01 18:33:23.121414 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.121391    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3191b6b2-9429-4e38-80e3-351efe491d9e-proxy-tls\") pod \"sequence-graph-293b3-8f6998d6c-5gtvf\" (UID: \"3191b6b2-9429-4e38-80e3-351efe491d9e\") " pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:23.121546 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.121453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3191b6b2-9429-4e38-80e3-351efe491d9e-openshift-service-ca-bundle\") pod \"sequence-graph-293b3-8f6998d6c-5gtvf\" (UID: \"3191b6b2-9429-4e38-80e3-351efe491d9e\") " pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:23.221860 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.221834    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3191b6b2-9429-4e38-80e3-351efe491d9e-openshift-service-ca-bundle\") pod \"sequence-graph-293b3-8f6998d6c-5gtvf\" (UID: \"3191b6b2-9429-4e38-80e3-351efe491d9e\") " pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:23.221988 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.221893    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3191b6b2-9429-4e38-80e3-351efe491d9e-proxy-tls\") pod \"sequence-graph-293b3-8f6998d6c-5gtvf\" (UID: \"3191b6b2-9429-4e38-80e3-351efe491d9e\") " pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:23.222041 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:33:23.221999    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-293b3-serving-cert: secret "sequence-graph-293b3-serving-cert" not found
Jul 01 18:33:23.222076 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:33:23.222060    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3191b6b2-9429-4e38-80e3-351efe491d9e-proxy-tls podName:3191b6b2-9429-4e38-80e3-351efe491d9e nodeName:}" failed. No retries permitted until 2026-07-01 18:33:23.72204416 +0000 UTC m=+1612.952116985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3191b6b2-9429-4e38-80e3-351efe491d9e-proxy-tls") pod "sequence-graph-293b3-8f6998d6c-5gtvf" (UID: "3191b6b2-9429-4e38-80e3-351efe491d9e") : secret "sequence-graph-293b3-serving-cert" not found
Jul 01 18:33:23.222466 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.222448    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3191b6b2-9429-4e38-80e3-351efe491d9e-openshift-service-ca-bundle\") pod \"sequence-graph-293b3-8f6998d6c-5gtvf\" (UID: \"3191b6b2-9429-4e38-80e3-351efe491d9e\") " pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:23.536860 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.536835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:33:23.726471 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.726439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3191b6b2-9429-4e38-80e3-351efe491d9e-proxy-tls\") pod \"sequence-graph-293b3-8f6998d6c-5gtvf\" (UID: \"3191b6b2-9429-4e38-80e3-351efe491d9e\") " pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:23.728725 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.728704    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3191b6b2-9429-4e38-80e3-351efe491d9e-proxy-tls\") pod \"sequence-graph-293b3-8f6998d6c-5gtvf\" (UID: \"3191b6b2-9429-4e38-80e3-351efe491d9e\") " pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:23.960416 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:23.960333    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:24.086662 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:24.086521    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"]
Jul 01 18:33:24.089406 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:33:24.089382    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3191b6b2_9429_4e38_80e3_351efe491d9e.slice/crio-834e7d73989cec6f2db511a15e331cdb85b843994a9b67a61f12f072d8f4cb5b WatchSource:0}: Error finding container 834e7d73989cec6f2db511a15e331cdb85b843994a9b67a61f12f072d8f4cb5b: Status 404 returned error can't find the container with id 834e7d73989cec6f2db511a15e331cdb85b843994a9b67a61f12f072d8f4cb5b
Jul 01 18:33:24.425479 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:24.425449    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" event={"ID":"3191b6b2-9429-4e38-80e3-351efe491d9e","Type":"ContainerStarted","Data":"137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a"}
Jul 01 18:33:24.425656 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:24.425497    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" event={"ID":"3191b6b2-9429-4e38-80e3-351efe491d9e","Type":"ContainerStarted","Data":"834e7d73989cec6f2db511a15e331cdb85b843994a9b67a61f12f072d8f4cb5b"}
Jul 01 18:33:24.425656 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:24.425593    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:33:24.442268 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:24.442211    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" podStartSLOduration=1.442198908 podStartE2EDuration="1.442198908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:24.440721594 +0000 UTC m=+1613.670794424" watchObservedRunningTime="2026-07-01 18:33:24.442198908 +0000 UTC m=+1613.672271741"
Jul 01 18:33:30.437174 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:33:30.437142    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:34:47.036885 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:34:47.036856    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:36:31.592257 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:36:31.592213    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:36:31.593490 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:36:31.593460    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:36:31.598546 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:36:31.598523    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:36:31.599963 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:36:31.599945    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:36:47.205908 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:36:47.205856    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:36:58.495185 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:36:58.495126    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:40:41.747041 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.747011    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"]
Jul 01 18:40:41.749503 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.747269    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4" containerID="cri-o://c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c" gracePeriod=30
Jul 01 18:40:41.794232 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.794187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:40:41.886733 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.886707    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:40:41.923414 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.923390    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"]
Jul 01 18:40:41.923816 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.923784    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container" containerID="cri-o://86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b" gracePeriod=30
Jul 01 18:40:41.923816 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.923803    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kube-rbac-proxy" containerID="cri-o://b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901" gracePeriod=30
Jul 01 18:40:41.932557 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.932533    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"]
Jul 01 18:40:41.936783 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.936651    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:41.939128 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.939110    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-fbcf2-kube-rbac-proxy-sar-config\""
Jul 01 18:40:41.939205 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.939119    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-fbcf2-predictor-serving-cert\""
Jul 01 18:40:41.947819 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.947799    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"]
Jul 01 18:40:41.961852 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:41.961833    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:40:42.041948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.041916    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:40:42.114492 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.114472    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:40:42.126635 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.126609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-fbcf2-predictor-56df98589b-4qbbb\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") " pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.126756 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.126660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/196a5e57-de4b-4d01-b2ef-f2a573144ea5-proxy-tls\") pod \"success-200-isvc-fbcf2-predictor-56df98589b-4qbbb\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") " pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.126818 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.126751    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9jvc\" (UniqueName: \"kubernetes.io/projected/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-api-access-v9jvc\") pod \"success-200-isvc-fbcf2-predictor-56df98589b-4qbbb\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") " pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.227680 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.227653    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/196a5e57-de4b-4d01-b2ef-f2a573144ea5-proxy-tls\") pod \"success-200-isvc-fbcf2-predictor-56df98589b-4qbbb\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") " pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.227773 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.227727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9jvc\" (UniqueName: \"kubernetes.io/projected/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-api-access-v9jvc\") pod \"success-200-isvc-fbcf2-predictor-56df98589b-4qbbb\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") " pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.227819 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.227774    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-fbcf2-predictor-56df98589b-4qbbb\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") " pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.228521 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.228498    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-fbcf2-predictor-56df98589b-4qbbb\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") " pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.230020 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.229996    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/196a5e57-de4b-4d01-b2ef-f2a573144ea5-proxy-tls\") pod \"success-200-isvc-fbcf2-predictor-56df98589b-4qbbb\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") " pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.236111 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.236080    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9jvc\" (UniqueName: \"kubernetes.io/projected/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-api-access-v9jvc\") pod \"success-200-isvc-fbcf2-predictor-56df98589b-4qbbb\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") " pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.249863 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.249842    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:42.292763 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.292668    2567 generic.go:356] "Generic (PLEG): container finished" podID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerID="b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901" exitCode=2
Jul 01 18:40:42.292763 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.292735    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" event={"ID":"a64ad961-1fb4-468f-9acc-4e72cc202d9a","Type":"ContainerDied","Data":"b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901"}
Jul 01 18:40:42.384151 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.384127    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"]
Jul 01 18:40:42.386673 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:40:42.386648    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196a5e57_de4b_4d01_b2ef_f2a573144ea5.slice/crio-364b86276eebe4e943427c8aab9d54759d795ee3d548de9e0c918d5624f6ef32 WatchSource:0}: Error finding container 364b86276eebe4e943427c8aab9d54759d795ee3d548de9e0c918d5624f6ef32: Status 404 returned error can't find the container with id 364b86276eebe4e943427c8aab9d54759d795ee3d548de9e0c918d5624f6ef32
Jul 01 18:40:42.713625 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:42.713557    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:40:43.298830 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:43.298798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" event={"ID":"196a5e57-de4b-4d01-b2ef-f2a573144ea5","Type":"ContainerStarted","Data":"9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd"}
Jul 01 18:40:43.299219 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:43.298859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" event={"ID":"196a5e57-de4b-4d01-b2ef-f2a573144ea5","Type":"ContainerStarted","Data":"811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57"}
Jul 01 18:40:43.299219 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:43.298883    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" event={"ID":"196a5e57-de4b-4d01-b2ef-f2a573144ea5","Type":"ContainerStarted","Data":"364b86276eebe4e943427c8aab9d54759d795ee3d548de9e0c918d5624f6ef32"}
Jul 01 18:40:43.299219 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:43.298932    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:43.299219 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:43.298989    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:43.300224 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:43.300202    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.51:8080: connect: connection refused"
Jul 01 18:40:43.316482 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:43.316443    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podStartSLOduration=2.316430904 podStartE2EDuration="2.316430904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:40:43.315190157 +0000 UTC m=+2052.545263012" watchObservedRunningTime="2026-07-01 18:40:43.316430904 +0000 UTC m=+2052.546503736"
Jul 01 18:40:43.879906 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:43.879871    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.46:8643/healthz\": dial tcp 10.134.0.46:8643: connect: connection refused"
Jul 01 18:40:43.884193 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:43.884170    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.46:8080: connect: connection refused"
Jul 01 18:40:44.303201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.303165    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.51:8080: connect: connection refused"
Jul 01 18:40:44.464461 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.464441    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:40:44.647064 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.647041    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a64ad961-1fb4-468f-9acc-4e72cc202d9a-proxy-tls\") pod \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") "
Jul 01 18:40:44.647179 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.647077    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-rbac-proxy-sar-config\") pod \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") "
Jul 01 18:40:44.647179 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.647130    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26x2q\" (UniqueName: \"kubernetes.io/projected/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-api-access-26x2q\") pod \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\" (UID: \"a64ad961-1fb4-468f-9acc-4e72cc202d9a\") "
Jul 01 18:40:44.647472 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.647438    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a64ad961-1fb4-468f-9acc-4e72cc202d9a" (UID: "a64ad961-1fb4-468f-9acc-4e72cc202d9a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:40:44.649004 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.648976    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a64ad961-1fb4-468f-9acc-4e72cc202d9a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a64ad961-1fb4-468f-9acc-4e72cc202d9a" (UID: "a64ad961-1fb4-468f-9acc-4e72cc202d9a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:40:44.649081 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.649000    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-api-access-26x2q" (OuterVolumeSpecName: "kube-api-access-26x2q") pod "a64ad961-1fb4-468f-9acc-4e72cc202d9a" (UID: "a64ad961-1fb4-468f-9acc-4e72cc202d9a"). InnerVolumeSpecName "kube-api-access-26x2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:40:44.747893 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.747871    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26x2q\" (UniqueName: \"kubernetes.io/projected/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-api-access-26x2q\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:40:44.747893 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.747891    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a64ad961-1fb4-468f-9acc-4e72cc202d9a-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:40:44.748007 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:44.747900    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a64ad961-1fb4-468f-9acc-4e72cc202d9a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:40:45.176417 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.176388    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:40:45.308456 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.308428    2567 generic.go:356] "Generic (PLEG): container finished" podID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerID="86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b" exitCode=0
Jul 01 18:40:45.308732 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.308470    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" event={"ID":"a64ad961-1fb4-468f-9acc-4e72cc202d9a","Type":"ContainerDied","Data":"86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b"}
Jul 01 18:40:45.308732 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.308486    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"
Jul 01 18:40:45.308732 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.308524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq" event={"ID":"a64ad961-1fb4-468f-9acc-4e72cc202d9a","Type":"ContainerDied","Data":"58a4d254a27c5af91098767f9951bbdfb47f11c7f18b379745989d85b296bbfc"}
Jul 01 18:40:45.308732 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.308561    2567 scope.go:117] "RemoveContainer" containerID="b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901"
Jul 01 18:40:45.316638 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.316622    2567 scope.go:117] "RemoveContainer" containerID="86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b"
Jul 01 18:40:45.323570 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.323546    2567 scope.go:117] "RemoveContainer" containerID="b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901"
Jul 01 18:40:45.323793 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:40:45.323777    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901\": container with ID starting with b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901 not found: ID does not exist" containerID="b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901"
Jul 01 18:40:45.323840 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.323800    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901"} err="failed to get container status \"b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901\": rpc error: code = NotFound desc = could not find container \"b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901\": container with ID starting with b47456435949b939de803cb90973f8bf94d0e0d2f30d43f686758020b955a901 not found: ID does not exist"
Jul 01 18:40:45.323840 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.323814    2567 scope.go:117] "RemoveContainer" containerID="86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b"
Jul 01 18:40:45.324020 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:40:45.324004    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b\": container with ID starting with 86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b not found: ID does not exist" containerID="86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b"
Jul 01 18:40:45.324067 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.324027    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b"} err="failed to get container status \"86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b\": rpc error: code = NotFound desc = could not find container \"86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b\": container with ID starting with 86a9951d66425796a0b891fbdbc2cfa393e3bbeefa70783b5aa0758c18a2e23b not found: ID does not exist"
Jul 01 18:40:45.329100 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.329080    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"]
Jul 01 18:40:45.333074 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.333053    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c1eb4-predictor-6547fdb46d-zh9tq"]
Jul 01 18:40:45.427472 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:45.427422    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" path="/var/lib/kubelet/pods/a64ad961-1fb4-468f-9acc-4e72cc202d9a/volumes"
Jul 01 18:40:49.306981 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:49.306952    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:40:49.307402 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:49.307375    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.51:8080: connect: connection refused"
Jul 01 18:40:50.175971 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:50.175933    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:40:55.176079 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:55.176005    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:40:55.176449 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:55.176098    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:40:59.307553 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:40:59.307511    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.51:8080: connect: connection refused"
Jul 01 18:41:00.176421 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:00.176387    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:41:05.175492 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:05.175459    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:41:09.307316 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:09.307278    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.51:8080: connect: connection refused"
Jul 01 18:41:10.176283 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:10.176227    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:41:11.886929 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:11.886899    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:41:11.933257 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:11.933215    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-proxy-tls\") pod \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\" (UID: \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\") "
Jul 01 18:41:11.933406 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:11.933388    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-openshift-service-ca-bundle\") pod \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\" (UID: \"6df8fd9e-778f-4602-b75d-cc1436c7a0a4\") "
Jul 01 18:41:11.933811 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:11.933777    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6df8fd9e-778f-4602-b75d-cc1436c7a0a4" (UID: "6df8fd9e-778f-4602-b75d-cc1436c7a0a4"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:41:11.935216 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:11.935192    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6df8fd9e-778f-4602-b75d-cc1436c7a0a4" (UID: "6df8fd9e-778f-4602-b75d-cc1436c7a0a4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:41:12.034009 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.033987    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:41:12.034009 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.034007    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6df8fd9e-778f-4602-b75d-cc1436c7a0a4-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:41:12.435591 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.435518    2567 generic.go:356] "Generic (PLEG): container finished" podID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerID="c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c" exitCode=0
Jul 01 18:41:12.435591 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.435561    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"
Jul 01 18:41:12.435730 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.435602    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" event={"ID":"6df8fd9e-778f-4602-b75d-cc1436c7a0a4","Type":"ContainerDied","Data":"c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c"}
Jul 01 18:41:12.435730 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.435651    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr" event={"ID":"6df8fd9e-778f-4602-b75d-cc1436c7a0a4","Type":"ContainerDied","Data":"de0e0439cb8c98d4c5c2c4c29385c57930696f366fdee832698beedd40cdb453"}
Jul 01 18:41:12.435730 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.435672    2567 scope.go:117] "RemoveContainer" containerID="c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c"
Jul 01 18:41:12.443720 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.443707    2567 scope.go:117] "RemoveContainer" containerID="c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c"
Jul 01 18:41:12.443968 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:41:12.443952    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c\": container with ID starting with c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c not found: ID does not exist" containerID="c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c"
Jul 01 18:41:12.444011 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.443975    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c"} err="failed to get container status \"c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c\": rpc error: code = NotFound desc = could not find container \"c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c\": container with ID starting with c369567748971bbbfe0da91fce332e7a1d640bd3054c2f8a02ac3c15a7cb5a3c not found: ID does not exist"
Jul 01 18:41:12.456132 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.456115    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"]
Jul 01 18:41:12.460860 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:12.460840    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c1eb4-59675ff8b-b6nwr"]
Jul 01 18:41:13.427725 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:13.427688    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" path="/var/lib/kubelet/pods/6df8fd9e-778f-4602-b75d-cc1436c7a0a4/volumes"
Jul 01 18:41:19.308161 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:19.308124    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.51:8080: connect: connection refused"
Jul 01 18:41:29.308153 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:29.308126    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:41:31.622756 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:31.622730    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:41:31.626934 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:31.626921    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:41:31.629205 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:31.629190    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:41:31.633489 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:31.633474    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:41:37.754505 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.754466    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"]
Jul 01 18:41:37.754871 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.754634    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3" containerID="cri-o://137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a" gracePeriod=30
Jul 01 18:41:37.885086 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.885057    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"]
Jul 01 18:41:37.885324 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.885291    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container" containerID="cri-o://3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47" gracePeriod=30
Jul 01 18:41:37.885463 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.885378    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kube-rbac-proxy" containerID="cri-o://750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3" gracePeriod=30
Jul 01 18:41:37.887714 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.887688    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:41:37.888856 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.888836    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"]
Jul 01 18:41:37.889386 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.889364    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container"
Jul 01 18:41:37.889386 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.889386    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container"
Jul 01 18:41:37.889528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.889398    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4"
Jul 01 18:41:37.889528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.889406    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4"
Jul 01 18:41:37.889528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.889421    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kube-rbac-proxy"
Jul 01 18:41:37.889528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.889430    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kube-rbac-proxy"
Jul 01 18:41:37.889528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.889524    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6df8fd9e-778f-4602-b75d-cc1436c7a0a4" containerName="ensemble-graph-c1eb4"
Jul 01 18:41:37.889745 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.889536    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kserve-container"
Jul 01 18:41:37.889745 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.889544    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64ad961-1fb4-468f-9acc-4e72cc202d9a" containerName="kube-rbac-proxy"
Jul 01 18:41:37.892750 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.892732    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:37.895383 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.895364    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-60085-kube-rbac-proxy-sar-config\""
Jul 01 18:41:37.895456 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.895396    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-60085-predictor-serving-cert\""
Jul 01 18:41:37.905121 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.904652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"]
Jul 01 18:41:37.982701 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:37.982676    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:41:38.024214 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.024164    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdmmh\" (UniqueName: \"kubernetes.io/projected/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-api-access-cdmmh\") pod \"success-200-isvc-60085-predictor-5b6dd5d96d-gltrl\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") " pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.024214 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.024198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-proxy-tls\") pod \"success-200-isvc-60085-predictor-5b6dd5d96d-gltrl\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") " pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.024370 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.024228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-60085-predictor-5b6dd5d96d-gltrl\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") " pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.082487 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.082461    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:41:38.125518 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.125498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmmh\" (UniqueName: \"kubernetes.io/projected/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-api-access-cdmmh\") pod \"success-200-isvc-60085-predictor-5b6dd5d96d-gltrl\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") " pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.125629 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.125532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-proxy-tls\") pod \"success-200-isvc-60085-predictor-5b6dd5d96d-gltrl\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") " pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.125629 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.125571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-60085-predictor-5b6dd5d96d-gltrl\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") " pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.126201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.126182    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-60085-predictor-5b6dd5d96d-gltrl\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") " pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.127730 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.127710    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-proxy-tls\") pod \"success-200-isvc-60085-predictor-5b6dd5d96d-gltrl\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") " pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.134669 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.134651    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdmmh\" (UniqueName: \"kubernetes.io/projected/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-api-access-cdmmh\") pod \"success-200-isvc-60085-predictor-5b6dd5d96d-gltrl\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") " pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.209631 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.209610    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.329253 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.329216    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:41:38.344394 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.344373    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"]
Jul 01 18:41:38.346441 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:41:38.346419    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56af3c3a_ceb8_4dad_9d0a_9cc3071b056e.slice/crio-3c757d7d5152ac9f1587c1adf95c2ee988f1a8071632cb17973d1324ff55030a WatchSource:0}: Error finding container 3c757d7d5152ac9f1587c1adf95c2ee988f1a8071632cb17973d1324ff55030a: Status 404 returned error can't find the container with id 3c757d7d5152ac9f1587c1adf95c2ee988f1a8071632cb17973d1324ff55030a
Jul 01 18:41:38.545809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.545741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" event={"ID":"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e","Type":"ContainerStarted","Data":"f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c"}
Jul 01 18:41:38.545809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.545796    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" event={"ID":"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e","Type":"ContainerStarted","Data":"cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb"}
Jul 01 18:41:38.545991 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.545830    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" event={"ID":"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e","Type":"ContainerStarted","Data":"3c757d7d5152ac9f1587c1adf95c2ee988f1a8071632cb17973d1324ff55030a"}
Jul 01 18:41:38.545991 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.545856    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.545991 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.545875    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:38.547697 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.547661    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.52:8080: connect: connection refused"
Jul 01 18:41:38.547808 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.547696    2567 generic.go:356] "Generic (PLEG): container finished" podID="7962bc6c-a206-4599-a2da-a43cc1669814" containerID="750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3" exitCode=2
Jul 01 18:41:38.547808 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.547767    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" event={"ID":"7962bc6c-a206-4599-a2da-a43cc1669814","Type":"ContainerDied","Data":"750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3"}
Jul 01 18:41:38.567428 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:38.567392    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" podStartSLOduration=1.567381141 podStartE2EDuration="1.567381141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:41:38.566056433 +0000 UTC m=+2107.796129265" watchObservedRunningTime="2026-07-01 18:41:38.567381141 +0000 UTC m=+2107.797453972"
Jul 01 18:41:39.552118 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:39.552078    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.52:8080: connect: connection refused"
Jul 01 18:41:40.143484 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.143440    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.48:8643/healthz\": dial tcp 10.134.0.48:8643: connect: connection refused"
Jul 01 18:41:40.147786 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.147757    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.48:8080: connect: connection refused"
Jul 01 18:41:40.436602 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.436571    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:41:40.532845 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.532818    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:41:40.557907 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.557882    2567 generic.go:356] "Generic (PLEG): container finished" podID="7962bc6c-a206-4599-a2da-a43cc1669814" containerID="3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47" exitCode=0
Jul 01 18:41:40.558178 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.557927    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"
Jul 01 18:41:40.558178 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.557939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" event={"ID":"7962bc6c-a206-4599-a2da-a43cc1669814","Type":"ContainerDied","Data":"3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47"}
Jul 01 18:41:40.558178 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.558011    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg" event={"ID":"7962bc6c-a206-4599-a2da-a43cc1669814","Type":"ContainerDied","Data":"cceb25339f21ee0cbbc6315546fd951ea3619d181980449937a9067ab94eb179"}
Jul 01 18:41:40.558178 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.558052    2567 scope.go:117] "RemoveContainer" containerID="750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3"
Jul 01 18:41:40.565847 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.565830    2567 scope.go:117] "RemoveContainer" containerID="3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47"
Jul 01 18:41:40.573397 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.573379    2567 scope.go:117] "RemoveContainer" containerID="750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3"
Jul 01 18:41:40.573638 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:41:40.573621    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3\": container with ID starting with 750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3 not found: ID does not exist" containerID="750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3"
Jul 01 18:41:40.573687 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.573646    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3"} err="failed to get container status \"750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3\": rpc error: code = NotFound desc = could not find container \"750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3\": container with ID starting with 750ac6214d6c4302bb0f172c3a11542d64289df163e3626d2a0f3a76901193e3 not found: ID does not exist"
Jul 01 18:41:40.573687 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.573662    2567 scope.go:117] "RemoveContainer" containerID="3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47"
Jul 01 18:41:40.573964 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:41:40.573944    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47\": container with ID starting with 3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47 not found: ID does not exist" containerID="3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47"
Jul 01 18:41:40.574009 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.573972    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47"} err="failed to get container status \"3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47\": rpc error: code = NotFound desc = could not find container \"3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47\": container with ID starting with 3376a5ef473fc6a7566e2e61510a49b7b788b7269e1e7852f9f34328db36be47 not found: ID does not exist"
Jul 01 18:41:40.645077 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.645055    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7962bc6c-a206-4599-a2da-a43cc1669814-kube-rbac-proxy-sar-config\") pod \"7962bc6c-a206-4599-a2da-a43cc1669814\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") "
Jul 01 18:41:40.645169 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.645116    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7962bc6c-a206-4599-a2da-a43cc1669814-proxy-tls\") pod \"7962bc6c-a206-4599-a2da-a43cc1669814\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") "
Jul 01 18:41:40.645169 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.645140    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vklh9\" (UniqueName: \"kubernetes.io/projected/7962bc6c-a206-4599-a2da-a43cc1669814-kube-api-access-vklh9\") pod \"7962bc6c-a206-4599-a2da-a43cc1669814\" (UID: \"7962bc6c-a206-4599-a2da-a43cc1669814\") "
Jul 01 18:41:40.645425 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.645402    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7962bc6c-a206-4599-a2da-a43cc1669814-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7962bc6c-a206-4599-a2da-a43cc1669814" (UID: "7962bc6c-a206-4599-a2da-a43cc1669814"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:41:40.646916 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.646896    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7962bc6c-a206-4599-a2da-a43cc1669814-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7962bc6c-a206-4599-a2da-a43cc1669814" (UID: "7962bc6c-a206-4599-a2da-a43cc1669814"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:41:40.646916 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.646896    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7962bc6c-a206-4599-a2da-a43cc1669814-kube-api-access-vklh9" (OuterVolumeSpecName: "kube-api-access-vklh9") pod "7962bc6c-a206-4599-a2da-a43cc1669814" (UID: "7962bc6c-a206-4599-a2da-a43cc1669814"). InnerVolumeSpecName "kube-api-access-vklh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:41:40.746545 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.746518    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7962bc6c-a206-4599-a2da-a43cc1669814-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:41:40.746545 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.746545    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7962bc6c-a206-4599-a2da-a43cc1669814-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:41:40.746545 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.746554    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vklh9\" (UniqueName: \"kubernetes.io/projected/7962bc6c-a206-4599-a2da-a43cc1669814-kube-api-access-vklh9\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:41:40.878641 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.878618    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"]
Jul 01 18:41:40.881610 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:40.881594    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-293b3-predictor-67c5856c84-z6lcg"]
Jul 01 18:41:41.426895 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.426868    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" path="/var/lib/kubelet/pods/7962bc6c-a206-4599-a2da-a43cc1669814/volumes"
Jul 01 18:41:41.958153 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.958125    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"]
Jul 01 18:41:41.958528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.958506    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kube-rbac-proxy"
Jul 01 18:41:41.958528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.958518    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kube-rbac-proxy"
Jul 01 18:41:41.958528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.958529    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container"
Jul 01 18:41:41.958632 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.958533    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container"
Jul 01 18:41:41.958632 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.958585    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kserve-container"
Jul 01 18:41:41.958632 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.958596    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7962bc6c-a206-4599-a2da-a43cc1669814" containerName="kube-rbac-proxy"
Jul 01 18:41:41.962983 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.962968    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:41.964756 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.964735    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:41:41.965373 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.965357    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-fbcf2-kube-rbac-proxy-sar-config\""
Jul 01 18:41:41.965444 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.965376    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-fbcf2-serving-cert\""
Jul 01 18:41:41.970579 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:41.970562    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"]
Jul 01 18:41:42.056514 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:42.056492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5acf7865-4f8a-48e8-a923-e75376e6e133-openshift-service-ca-bundle\") pod \"splitter-graph-fbcf2-865d699f8c-46bjm\" (UID: \"5acf7865-4f8a-48e8-a923-e75376e6e133\") " pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:42.056616 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:42.056523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5acf7865-4f8a-48e8-a923-e75376e6e133-proxy-tls\") pod \"splitter-graph-fbcf2-865d699f8c-46bjm\" (UID: \"5acf7865-4f8a-48e8-a923-e75376e6e133\") " pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:42.156843 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:42.156820    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5acf7865-4f8a-48e8-a923-e75376e6e133-openshift-service-ca-bundle\") pod \"splitter-graph-fbcf2-865d699f8c-46bjm\" (UID: \"5acf7865-4f8a-48e8-a923-e75376e6e133\") " pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:42.156940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:42.156851    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5acf7865-4f8a-48e8-a923-e75376e6e133-proxy-tls\") pod \"splitter-graph-fbcf2-865d699f8c-46bjm\" (UID: \"5acf7865-4f8a-48e8-a923-e75376e6e133\") " pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:42.157051 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:41:42.157032    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-fbcf2-serving-cert: secret "splitter-graph-fbcf2-serving-cert" not found
Jul 01 18:41:42.157119 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:41:42.157090    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5acf7865-4f8a-48e8-a923-e75376e6e133-proxy-tls podName:5acf7865-4f8a-48e8-a923-e75376e6e133 nodeName:}" failed. No retries permitted until 2026-07-01 18:41:42.657073283 +0000 UTC m=+2111.887146094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/5acf7865-4f8a-48e8-a923-e75376e6e133-proxy-tls") pod "splitter-graph-fbcf2-865d699f8c-46bjm" (UID: "5acf7865-4f8a-48e8-a923-e75376e6e133") : secret "splitter-graph-fbcf2-serving-cert" not found
Jul 01 18:41:42.157467 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:42.157448    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5acf7865-4f8a-48e8-a923-e75376e6e133-openshift-service-ca-bundle\") pod \"splitter-graph-fbcf2-865d699f8c-46bjm\" (UID: \"5acf7865-4f8a-48e8-a923-e75376e6e133\") " pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:42.284945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:42.284920    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:41:42.662318 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:42.662257    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5acf7865-4f8a-48e8-a923-e75376e6e133-proxy-tls\") pod \"splitter-graph-fbcf2-865d699f8c-46bjm\" (UID: \"5acf7865-4f8a-48e8-a923-e75376e6e133\") " pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:42.664502 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:42.664482    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5acf7865-4f8a-48e8-a923-e75376e6e133-proxy-tls\") pod \"splitter-graph-fbcf2-865d699f8c-46bjm\" (UID: \"5acf7865-4f8a-48e8-a923-e75376e6e133\") " pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:42.873677 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:42.873657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:43.000930 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:43.000908    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"]
Jul 01 18:41:43.002879 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:41:43.002854    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5acf7865_4f8a_48e8_a923_e75376e6e133.slice/crio-b0d780f3d6ad5b14e983a2ba73a9457162b613499270a467cda483f033ebf652 WatchSource:0}: Error finding container b0d780f3d6ad5b14e983a2ba73a9457162b613499270a467cda483f033ebf652: Status 404 returned error can't find the container with id b0d780f3d6ad5b14e983a2ba73a9457162b613499270a467cda483f033ebf652
Jul 01 18:41:43.572522 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:43.572493    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" event={"ID":"5acf7865-4f8a-48e8-a923-e75376e6e133","Type":"ContainerStarted","Data":"22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22"}
Jul 01 18:41:43.572650 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:43.572541    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" event={"ID":"5acf7865-4f8a-48e8-a923-e75376e6e133","Type":"ContainerStarted","Data":"b0d780f3d6ad5b14e983a2ba73a9457162b613499270a467cda483f033ebf652"}
Jul 01 18:41:43.572650 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:43.572561    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:43.588096 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:43.588051    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" podStartSLOduration=2.588039028 podStartE2EDuration="2.588039028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:41:43.587675112 +0000 UTC m=+2112.817747945" watchObservedRunningTime="2026-07-01 18:41:43.588039028 +0000 UTC m=+2112.818111859"
Jul 01 18:41:44.556732 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:44.556710    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:41:44.557268 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:44.557224    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.52:8080: connect: connection refused"
Jul 01 18:41:45.435261 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:45.435211    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:41:49.582445 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:49.582420    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:41:50.435716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:50.435685    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:41:50.435881 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:50.435774    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:41:52.057936 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.057910    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"]
Jul 01 18:41:52.058289 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.058059    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2" containerID="cri-o://22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22" gracePeriod=30
Jul 01 18:41:52.085997 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.085964    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:41:52.195980 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.195945    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"]
Jul 01 18:41:52.196307 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.196280    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container" containerID="cri-o://811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57" gracePeriod=30
Jul 01 18:41:52.196441 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.196356    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kube-rbac-proxy" containerID="cri-o://9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd" gracePeriod=30
Jul 01 18:41:52.218613 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.218590    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"]
Jul 01 18:41:52.223106 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.223088    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.225793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.225773    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1f8d1-kube-rbac-proxy-sar-config\""
Jul 01 18:41:52.225793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.225784    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1f8d1-predictor-serving-cert\""
Jul 01 18:41:52.232150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.232131    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"]
Jul 01 18:41:52.330906 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.330881    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/baa56398-d202-4968-82d2-b81cc5563f0f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") " pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.331025 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.330946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7bg\" (UniqueName: \"kubernetes.io/projected/baa56398-d202-4968-82d2-b81cc5563f0f-kube-api-access-tc7bg\") pod \"success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") " pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.331072 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.331040    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa56398-d202-4968-82d2-b81cc5563f0f-proxy-tls\") pod \"success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") " pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.432026 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.431997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7bg\" (UniqueName: \"kubernetes.io/projected/baa56398-d202-4968-82d2-b81cc5563f0f-kube-api-access-tc7bg\") pod \"success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") " pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.432187 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.432036    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa56398-d202-4968-82d2-b81cc5563f0f-proxy-tls\") pod \"success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") " pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.432187 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.432096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/baa56398-d202-4968-82d2-b81cc5563f0f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") " pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.432769 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.432736    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/baa56398-d202-4968-82d2-b81cc5563f0f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") " pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.434543 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.434519    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa56398-d202-4968-82d2-b81cc5563f0f-proxy-tls\") pod \"success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") " pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.439522 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.439502    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7bg\" (UniqueName: \"kubernetes.io/projected/baa56398-d202-4968-82d2-b81cc5563f0f-kube-api-access-tc7bg\") pod \"success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") " pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.535279 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.535256    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:52.619590 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.619557    2567 generic.go:356] "Generic (PLEG): container finished" podID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerID="9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd" exitCode=2
Jul 01 18:41:52.619745 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.619624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" event={"ID":"196a5e57-de4b-4d01-b2ef-f2a573144ea5","Type":"ContainerDied","Data":"9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd"}
Jul 01 18:41:52.683832 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:52.683804    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"]
Jul 01 18:41:52.685939 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:41:52.685911    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa56398_d202_4968_82d2_b81cc5563f0f.slice/crio-b33f239a0ea9b7714e4715d00a4b1bd63c8fe4b22d8cb4a538092212ec0324a8 WatchSource:0}: Error finding container b33f239a0ea9b7714e4715d00a4b1bd63c8fe4b22d8cb4a538092212ec0324a8: Status 404 returned error can't find the container with id b33f239a0ea9b7714e4715d00a4b1bd63c8fe4b22d8cb4a538092212ec0324a8
Jul 01 18:41:53.220572 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:53.220545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:41:53.624994 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:53.624961    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" event={"ID":"baa56398-d202-4968-82d2-b81cc5563f0f","Type":"ContainerStarted","Data":"969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99"}
Jul 01 18:41:53.625169 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:53.625014    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" event={"ID":"baa56398-d202-4968-82d2-b81cc5563f0f","Type":"ContainerStarted","Data":"09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7"}
Jul 01 18:41:53.625169 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:53.625039    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" event={"ID":"baa56398-d202-4968-82d2-b81cc5563f0f","Type":"ContainerStarted","Data":"b33f239a0ea9b7714e4715d00a4b1bd63c8fe4b22d8cb4a538092212ec0324a8"}
Jul 01 18:41:53.625169 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:53.625061    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:53.643550 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:53.643506    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" podStartSLOduration=1.6434928370000002 podStartE2EDuration="1.643492837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:41:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:41:53.6415638 +0000 UTC m=+2122.871636650" watchObservedRunningTime="2026-07-01 18:41:53.643492837 +0000 UTC m=+2122.873565668"
Jul 01 18:41:54.303487 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:54.303454    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.51:8643/healthz\": dial tcp 10.134.0.51:8643: connect: connection refused"
Jul 01 18:41:54.557576 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:54.557509    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.52:8080: connect: connection refused"
Jul 01 18:41:54.581594 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:54.581570    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:41:54.630216 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:54.630180    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:41:54.631508 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:54.631480    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.54:8080: connect: connection refused"
Jul 01 18:41:55.435609 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:55.435578    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:41:55.635575 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:55.635536    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.54:8080: connect: connection refused"
Jul 01 18:41:58.353618 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.353594    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:41:58.478659 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.478600    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-rbac-proxy-sar-config\") pod \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") "
Jul 01 18:41:58.478778 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.478676    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/196a5e57-de4b-4d01-b2ef-f2a573144ea5-proxy-tls\") pod \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") "
Jul 01 18:41:58.478778 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.478735    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9jvc\" (UniqueName: \"kubernetes.io/projected/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-api-access-v9jvc\") pod \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\" (UID: \"196a5e57-de4b-4d01-b2ef-f2a573144ea5\") "
Jul 01 18:41:58.478926 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.478904    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "196a5e57-de4b-4d01-b2ef-f2a573144ea5" (UID: "196a5e57-de4b-4d01-b2ef-f2a573144ea5"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:41:58.478979 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.478968    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:41:58.480497 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.480473    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/196a5e57-de4b-4d01-b2ef-f2a573144ea5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "196a5e57-de4b-4d01-b2ef-f2a573144ea5" (UID: "196a5e57-de4b-4d01-b2ef-f2a573144ea5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:41:58.480597 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.480567    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-api-access-v9jvc" (OuterVolumeSpecName: "kube-api-access-v9jvc") pod "196a5e57-de4b-4d01-b2ef-f2a573144ea5" (UID: "196a5e57-de4b-4d01-b2ef-f2a573144ea5"). InnerVolumeSpecName "kube-api-access-v9jvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:41:58.579861 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.579840    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/196a5e57-de4b-4d01-b2ef-f2a573144ea5-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:41:58.579861 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.579861    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9jvc\" (UniqueName: \"kubernetes.io/projected/196a5e57-de4b-4d01-b2ef-f2a573144ea5-kube-api-access-v9jvc\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:41:58.656573 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.656549    2567 generic.go:356] "Generic (PLEG): container finished" podID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerID="811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57" exitCode=0
Jul 01 18:41:58.656662 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.656578    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" event={"ID":"196a5e57-de4b-4d01-b2ef-f2a573144ea5","Type":"ContainerDied","Data":"811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57"}
Jul 01 18:41:58.656662 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.656597    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"
Jul 01 18:41:58.656662 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.656621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb" event={"ID":"196a5e57-de4b-4d01-b2ef-f2a573144ea5","Type":"ContainerDied","Data":"364b86276eebe4e943427c8aab9d54759d795ee3d548de9e0c918d5624f6ef32"}
Jul 01 18:41:58.656662 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.656644    2567 scope.go:117] "RemoveContainer" containerID="9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd"
Jul 01 18:41:58.665528 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.665513    2567 scope.go:117] "RemoveContainer" containerID="811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57"
Jul 01 18:41:58.672579 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.672557    2567 scope.go:117] "RemoveContainer" containerID="9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd"
Jul 01 18:41:58.672810 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:41:58.672792    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd\": container with ID starting with 9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd not found: ID does not exist" containerID="9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd"
Jul 01 18:41:58.672856 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.672818    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd"} err="failed to get container status \"9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd\": rpc error: code = NotFound desc = could not find container \"9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd\": container with ID starting with 9f61f2eeba4da83149b0aefa3108c62cd935ff0550395a0017d1b5db507df1dd not found: ID does not exist"
Jul 01 18:41:58.672856 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.672835    2567 scope.go:117] "RemoveContainer" containerID="811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57"
Jul 01 18:41:58.673038 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:41:58.673019    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57\": container with ID starting with 811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57 not found: ID does not exist" containerID="811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57"
Jul 01 18:41:58.673090 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.673047    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57"} err="failed to get container status \"811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57\": rpc error: code = NotFound desc = could not find container \"811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57\": container with ID starting with 811cfcc2f9cc785d3b9b940ee5976da060d4cf6b3dafef62c01dd012a1bb9b57 not found: ID does not exist"
Jul 01 18:41:58.677922 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.677902    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"]
Jul 01 18:41:58.681930 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:58.681909    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-fbcf2-predictor-56df98589b-4qbbb"]
Jul 01 18:41:59.426321 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:59.426294    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" path="/var/lib/kubelet/pods/196a5e57-de4b-4d01-b2ef-f2a573144ea5/volumes"
Jul 01 18:41:59.581646 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:41:59.581617    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:42:00.435137 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:00.435100    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:42:00.640301 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:00.640276    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:42:00.640690 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:00.640667    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.54:8080: connect: connection refused"
Jul 01 18:42:03.776748 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:03.776717    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:42:04.557699 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:04.557670    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.52:8080: connect: connection refused"
Jul 01 18:42:04.580975 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:04.580952    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:42:04.581085 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:04.581025    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:42:05.435103 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:05.435071    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:42:08.405300 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.405270    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:42:08.555250 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.555223    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3191b6b2-9429-4e38-80e3-351efe491d9e-proxy-tls\") pod \"3191b6b2-9429-4e38-80e3-351efe491d9e\" (UID: \"3191b6b2-9429-4e38-80e3-351efe491d9e\") "
Jul 01 18:42:08.555402 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.555277    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3191b6b2-9429-4e38-80e3-351efe491d9e-openshift-service-ca-bundle\") pod \"3191b6b2-9429-4e38-80e3-351efe491d9e\" (UID: \"3191b6b2-9429-4e38-80e3-351efe491d9e\") "
Jul 01 18:42:08.555596 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.555572    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3191b6b2-9429-4e38-80e3-351efe491d9e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3191b6b2-9429-4e38-80e3-351efe491d9e" (UID: "3191b6b2-9429-4e38-80e3-351efe491d9e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:42:08.557091 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.557068    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3191b6b2-9429-4e38-80e3-351efe491d9e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3191b6b2-9429-4e38-80e3-351efe491d9e" (UID: "3191b6b2-9429-4e38-80e3-351efe491d9e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:42:08.655855 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.655834    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3191b6b2-9429-4e38-80e3-351efe491d9e-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:42:08.655855 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.655855    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3191b6b2-9429-4e38-80e3-351efe491d9e-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:42:08.701650 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.701626    2567 generic.go:356] "Generic (PLEG): container finished" podID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerID="137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a" exitCode=0
Jul 01 18:42:08.701737 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.701674    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"
Jul 01 18:42:08.701737 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.701713    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" event={"ID":"3191b6b2-9429-4e38-80e3-351efe491d9e","Type":"ContainerDied","Data":"137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a"}
Jul 01 18:42:08.701815 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.701766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf" event={"ID":"3191b6b2-9429-4e38-80e3-351efe491d9e","Type":"ContainerDied","Data":"834e7d73989cec6f2db511a15e331cdb85b843994a9b67a61f12f072d8f4cb5b"}
Jul 01 18:42:08.701815 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.701788    2567 scope.go:117] "RemoveContainer" containerID="137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a"
Jul 01 18:42:08.710613 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.710598    2567 scope.go:117] "RemoveContainer" containerID="137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a"
Jul 01 18:42:08.710853 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:42:08.710837    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a\": container with ID starting with 137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a not found: ID does not exist" containerID="137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a"
Jul 01 18:42:08.710899 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.710861    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a"} err="failed to get container status \"137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a\": rpc error: code = NotFound desc = could not find container \"137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a\": container with ID starting with 137ffc31125c0680d6019026083aec16a420e04e7e1ff86da17c2609d0dd564a not found: ID does not exist"
Jul 01 18:42:08.723269 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.723232    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"]
Jul 01 18:42:08.727432 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:08.727414    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-293b3-8f6998d6c-5gtvf"]
Jul 01 18:42:09.427582 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:09.427552    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" path="/var/lib/kubelet/pods/3191b6b2-9429-4e38-80e3-351efe491d9e/volumes"
Jul 01 18:42:09.581982 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:09.581948    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:42:10.641001 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:10.640963    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.54:8080: connect: connection refused"
Jul 01 18:42:14.557610 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:14.557574    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.52:8080: connect: connection refused"
Jul 01 18:42:14.581985 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:14.581954    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:42:19.581819 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:19.581777    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:42:20.641375 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:20.641343    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.54:8080: connect: connection refused"
Jul 01 18:42:22.197914 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.197893    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:42:22.357799 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.357743    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5acf7865-4f8a-48e8-a923-e75376e6e133-proxy-tls\") pod \"5acf7865-4f8a-48e8-a923-e75376e6e133\" (UID: \"5acf7865-4f8a-48e8-a923-e75376e6e133\") "
Jul 01 18:42:22.357799 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.357777    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5acf7865-4f8a-48e8-a923-e75376e6e133-openshift-service-ca-bundle\") pod \"5acf7865-4f8a-48e8-a923-e75376e6e133\" (UID: \"5acf7865-4f8a-48e8-a923-e75376e6e133\") "
Jul 01 18:42:22.358132 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.358111    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5acf7865-4f8a-48e8-a923-e75376e6e133-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5acf7865-4f8a-48e8-a923-e75376e6e133" (UID: "5acf7865-4f8a-48e8-a923-e75376e6e133"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:42:22.359543 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.359524    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5acf7865-4f8a-48e8-a923-e75376e6e133-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5acf7865-4f8a-48e8-a923-e75376e6e133" (UID: "5acf7865-4f8a-48e8-a923-e75376e6e133"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:42:22.459221 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.459160    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5acf7865-4f8a-48e8-a923-e75376e6e133-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:42:22.459221 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.459191    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5acf7865-4f8a-48e8-a923-e75376e6e133-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:42:22.767197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.767131    2567 generic.go:356] "Generic (PLEG): container finished" podID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerID="22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22" exitCode=0
Jul 01 18:42:22.767197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.767174    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"
Jul 01 18:42:22.767364 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.767196    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" event={"ID":"5acf7865-4f8a-48e8-a923-e75376e6e133","Type":"ContainerDied","Data":"22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22"}
Jul 01 18:42:22.767364 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.767256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm" event={"ID":"5acf7865-4f8a-48e8-a923-e75376e6e133","Type":"ContainerDied","Data":"b0d780f3d6ad5b14e983a2ba73a9457162b613499270a467cda483f033ebf652"}
Jul 01 18:42:22.767364 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.767277    2567 scope.go:117] "RemoveContainer" containerID="22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22"
Jul 01 18:42:22.776235 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.776220    2567 scope.go:117] "RemoveContainer" containerID="22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22"
Jul 01 18:42:22.776498 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:42:22.776481    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22\": container with ID starting with 22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22 not found: ID does not exist" containerID="22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22"
Jul 01 18:42:22.776546 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.776506    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22"} err="failed to get container status \"22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22\": rpc error: code = NotFound desc = could not find container \"22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22\": container with ID starting with 22766815b36a1c5e8d60956789f4ccb6950731a4cc249ef231a070d92a6bff22 not found: ID does not exist"
Jul 01 18:42:22.788287 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.788267    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"]
Jul 01 18:42:22.791078 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:22.791060    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-fbcf2-865d699f8c-46bjm"]
Jul 01 18:42:23.427790 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:23.427754    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" path="/var/lib/kubelet/pods/5acf7865-4f8a-48e8-a923-e75376e6e133/volumes"
Jul 01 18:42:24.558770 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:24.558737    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:42:30.640805 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:30.640771    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.54:8080: connect: connection refused"
Jul 01 18:42:37.948255 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.948189    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:42:37.952252 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952222    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"]
Jul 01 18:42:37.952575 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952562    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kube-rbac-proxy"
Jul 01 18:42:37.952620 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952578    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kube-rbac-proxy"
Jul 01 18:42:37.952620 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952588    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container"
Jul 01 18:42:37.952620 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952593    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container"
Jul 01 18:42:37.952620 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952604    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3"
Jul 01 18:42:37.952620 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952609    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3"
Jul 01 18:42:37.952620 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952618    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2"
Jul 01 18:42:37.952793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952623    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2"
Jul 01 18:42:37.952793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952684    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5acf7865-4f8a-48e8-a923-e75376e6e133" containerName="splitter-graph-fbcf2"
Jul 01 18:42:37.952793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952691    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kserve-container"
Jul 01 18:42:37.952793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952697    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="196a5e57-de4b-4d01-b2ef-f2a573144ea5" containerName="kube-rbac-proxy"
Jul 01 18:42:37.952793 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.952705    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3191b6b2-9429-4e38-80e3-351efe491d9e" containerName="sequence-graph-293b3"
Jul 01 18:42:37.955600 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.955582    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:37.957837 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.957820    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-60085-kube-rbac-proxy-sar-config\""
Jul 01 18:42:37.957944 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.957821    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-60085-serving-cert\""
Jul 01 18:42:37.963470 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.963448    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"]
Jul 01 18:42:37.968539 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.968517    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3066e176-0337-4751-a566-a7995aac8c14-openshift-service-ca-bundle\") pod \"switch-graph-60085-86b755c89-djvlx\" (UID: \"3066e176-0337-4751-a566-a7995aac8c14\") " pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:37.968619 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:37.968570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3066e176-0337-4751-a566-a7995aac8c14-proxy-tls\") pod \"switch-graph-60085-86b755c89-djvlx\" (UID: \"3066e176-0337-4751-a566-a7995aac8c14\") " pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:38.069571 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:38.069549    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3066e176-0337-4751-a566-a7995aac8c14-openshift-service-ca-bundle\") pod \"switch-graph-60085-86b755c89-djvlx\" (UID: \"3066e176-0337-4751-a566-a7995aac8c14\") " pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:38.069656 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:38.069608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3066e176-0337-4751-a566-a7995aac8c14-proxy-tls\") pod \"switch-graph-60085-86b755c89-djvlx\" (UID: \"3066e176-0337-4751-a566-a7995aac8c14\") " pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:38.069708 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:42:38.069693    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-60085-serving-cert: secret "switch-graph-60085-serving-cert" not found
Jul 01 18:42:38.069745 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:42:38.069736    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3066e176-0337-4751-a566-a7995aac8c14-proxy-tls podName:3066e176-0337-4751-a566-a7995aac8c14 nodeName:}" failed. No retries permitted until 2026-07-01 18:42:38.569723089 +0000 UTC m=+2167.799795899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3066e176-0337-4751-a566-a7995aac8c14-proxy-tls") pod "switch-graph-60085-86b755c89-djvlx" (UID: "3066e176-0337-4751-a566-a7995aac8c14") : secret "switch-graph-60085-serving-cert" not found
Jul 01 18:42:38.070160 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:38.070145    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3066e176-0337-4751-a566-a7995aac8c14-openshift-service-ca-bundle\") pod \"switch-graph-60085-86b755c89-djvlx\" (UID: \"3066e176-0337-4751-a566-a7995aac8c14\") " pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:38.158727 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:38.158705    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:42:38.573765 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:38.573738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3066e176-0337-4751-a566-a7995aac8c14-proxy-tls\") pod \"switch-graph-60085-86b755c89-djvlx\" (UID: \"3066e176-0337-4751-a566-a7995aac8c14\") " pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:38.575809 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:38.575786    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3066e176-0337-4751-a566-a7995aac8c14-proxy-tls\") pod \"switch-graph-60085-86b755c89-djvlx\" (UID: \"3066e176-0337-4751-a566-a7995aac8c14\") " pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:38.867605 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:38.867563    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:38.987645 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:38.987622    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"]
Jul 01 18:42:38.990014 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:42:38.989979    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3066e176_0337_4751_a566_a7995aac8c14.slice/crio-d8ee474658992ffd3244fd72431de1db152cd9372ad1cb538f2ee92ae1a9d240 WatchSource:0}: Error finding container d8ee474658992ffd3244fd72431de1db152cd9372ad1cb538f2ee92ae1a9d240: Status 404 returned error can't find the container with id d8ee474658992ffd3244fd72431de1db152cd9372ad1cb538f2ee92ae1a9d240
Jul 01 18:42:39.840154 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:39.840124    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" event={"ID":"3066e176-0337-4751-a566-a7995aac8c14","Type":"ContainerStarted","Data":"5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328"}
Jul 01 18:42:39.840328 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:39.840172    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" event={"ID":"3066e176-0337-4751-a566-a7995aac8c14","Type":"ContainerStarted","Data":"d8ee474658992ffd3244fd72431de1db152cd9372ad1cb538f2ee92ae1a9d240"}
Jul 01 18:42:39.840328 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:39.840287    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:39.855766 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:39.855722    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" podStartSLOduration=2.855685706 podStartE2EDuration="2.855685706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:42:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:42:39.854851487 +0000 UTC m=+2169.084924340" watchObservedRunningTime="2026-07-01 18:42:39.855685706 +0000 UTC m=+2169.085758537"
Jul 01 18:42:40.641925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:40.641908    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:42:45.849179 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:45.849143    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:42:47.715761 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:47.715720    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:42:52.270588 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.270555    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"]
Jul 01 18:42:52.274249 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.274218    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:52.276597 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.276575    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-1f8d1-kube-rbac-proxy-sar-config\""
Jul 01 18:42:52.276723 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.276600    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-1f8d1-serving-cert\""
Jul 01 18:42:52.277852 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.277806    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:42:52.283232 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.283209    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"]
Jul 01 18:42:52.371739 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.371719    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08cb8d05-b37a-45df-bcc0-614a25013f98-proxy-tls\") pod \"splitter-graph-1f8d1-76dfc65fbc-hs22t\" (UID: \"08cb8d05-b37a-45df-bcc0-614a25013f98\") " pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:52.371841 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.371757    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cb8d05-b37a-45df-bcc0-614a25013f98-openshift-service-ca-bundle\") pod \"splitter-graph-1f8d1-76dfc65fbc-hs22t\" (UID: \"08cb8d05-b37a-45df-bcc0-614a25013f98\") " pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:52.472537 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.472513    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cb8d05-b37a-45df-bcc0-614a25013f98-openshift-service-ca-bundle\") pod \"splitter-graph-1f8d1-76dfc65fbc-hs22t\" (UID: \"08cb8d05-b37a-45df-bcc0-614a25013f98\") " pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:52.472633 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.472623    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08cb8d05-b37a-45df-bcc0-614a25013f98-proxy-tls\") pod \"splitter-graph-1f8d1-76dfc65fbc-hs22t\" (UID: \"08cb8d05-b37a-45df-bcc0-614a25013f98\") " pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:52.472740 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:42:52.472726    2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-1f8d1-serving-cert: secret "splitter-graph-1f8d1-serving-cert" not found
Jul 01 18:42:52.472793 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:42:52.472783    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08cb8d05-b37a-45df-bcc0-614a25013f98-proxy-tls podName:08cb8d05-b37a-45df-bcc0-614a25013f98 nodeName:}" failed. No retries permitted until 2026-07-01 18:42:52.972766908 +0000 UTC m=+2182.202839724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/08cb8d05-b37a-45df-bcc0-614a25013f98-proxy-tls") pod "splitter-graph-1f8d1-76dfc65fbc-hs22t" (UID: "08cb8d05-b37a-45df-bcc0-614a25013f98") : secret "splitter-graph-1f8d1-serving-cert" not found
Jul 01 18:42:52.473055 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.473036    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cb8d05-b37a-45df-bcc0-614a25013f98-openshift-service-ca-bundle\") pod \"splitter-graph-1f8d1-76dfc65fbc-hs22t\" (UID: \"08cb8d05-b37a-45df-bcc0-614a25013f98\") " pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:52.946539 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.946520    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:42:52.976826 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.976803    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08cb8d05-b37a-45df-bcc0-614a25013f98-proxy-tls\") pod \"splitter-graph-1f8d1-76dfc65fbc-hs22t\" (UID: \"08cb8d05-b37a-45df-bcc0-614a25013f98\") " pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:52.979002 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:52.978985    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08cb8d05-b37a-45df-bcc0-614a25013f98-proxy-tls\") pod \"splitter-graph-1f8d1-76dfc65fbc-hs22t\" (UID: \"08cb8d05-b37a-45df-bcc0-614a25013f98\") " pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:53.185147 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:53.185129    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:53.304186 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:53.304165    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"]
Jul 01 18:42:53.306809 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:42:53.306785    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cb8d05_b37a_45df_bcc0_614a25013f98.slice/crio-c1ff11ac5b399820b96e847cb6c4bd25553c952a09a8e63c6775da65d4746f7f WatchSource:0}: Error finding container c1ff11ac5b399820b96e847cb6c4bd25553c952a09a8e63c6775da65d4746f7f: Status 404 returned error can't find the container with id c1ff11ac5b399820b96e847cb6c4bd25553c952a09a8e63c6775da65d4746f7f
Jul 01 18:42:53.903387 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:53.903353    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" event={"ID":"08cb8d05-b37a-45df-bcc0-614a25013f98","Type":"ContainerStarted","Data":"cc95cf6f94cd816ba2923e65657e65cbada2c6528f5e89451ac33c5a3b41317b"}
Jul 01 18:42:53.903516 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:53.903406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" event={"ID":"08cb8d05-b37a-45df-bcc0-614a25013f98","Type":"ContainerStarted","Data":"c1ff11ac5b399820b96e847cb6c4bd25553c952a09a8e63c6775da65d4746f7f"}
Jul 01 18:42:53.903516 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:53.903478    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:42:53.920385 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:53.920346    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" podStartSLOduration=1.920334237 podStartE2EDuration="1.920334237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:42:53.918615696 +0000 UTC m=+2183.148688524" watchObservedRunningTime="2026-07-01 18:42:53.920334237 +0000 UTC m=+2183.150407068"
Jul 01 18:42:59.913166 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:42:59.913140    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:46:31.651409 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:46:31.651382    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:46:31.656326 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:46:31.656305    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:46:31.657414 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:46:31.657396    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:46:31.662041 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:46:31.662023    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:47:23.704224 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:47:23.704155    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:47:34.999925 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:47:34.999883    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:50:58.909067 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:50:58.909033    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:51:07.043625 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.043592    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"]
Jul 01 18:51:07.044071 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.043799    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1" containerID="cri-o://cc95cf6f94cd816ba2923e65657e65cbada2c6528f5e89451ac33c5a3b41317b" gracePeriod=30
Jul 01 18:51:07.069514 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.069469    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:51:07.164213 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.164190    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"]
Jul 01 18:51:07.164453 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.164429    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container" containerID="cri-o://09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7" gracePeriod=30
Jul 01 18:51:07.164534 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.164469    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kube-rbac-proxy" containerID="cri-o://969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99" gracePeriod=30
Jul 01 18:51:07.189831 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.189801    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:51:07.246406 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.246385    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:51:07.942206 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.942177    2567 generic.go:356] "Generic (PLEG): container finished" podID="baa56398-d202-4968-82d2-b81cc5563f0f" containerID="969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99" exitCode=2
Jul 01 18:51:07.942382 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:07.942264    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" event={"ID":"baa56398-d202-4968-82d2-b81cc5563f0f","Type":"ContainerDied","Data":"969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99"}
Jul 01 18:51:09.207126 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.207100    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:51:09.236511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.236486    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc7bg\" (UniqueName: \"kubernetes.io/projected/baa56398-d202-4968-82d2-b81cc5563f0f-kube-api-access-tc7bg\") pod \"baa56398-d202-4968-82d2-b81cc5563f0f\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") "
Jul 01 18:51:09.236628 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.236575    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/baa56398-d202-4968-82d2-b81cc5563f0f-kube-rbac-proxy-sar-config\") pod \"baa56398-d202-4968-82d2-b81cc5563f0f\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") "
Jul 01 18:51:09.236628 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.236610    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa56398-d202-4968-82d2-b81cc5563f0f-proxy-tls\") pod \"baa56398-d202-4968-82d2-b81cc5563f0f\" (UID: \"baa56398-d202-4968-82d2-b81cc5563f0f\") "
Jul 01 18:51:09.236881 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.236859    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa56398-d202-4968-82d2-b81cc5563f0f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "baa56398-d202-4968-82d2-b81cc5563f0f" (UID: "baa56398-d202-4968-82d2-b81cc5563f0f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:51:09.238384 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.238363    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa56398-d202-4968-82d2-b81cc5563f0f-kube-api-access-tc7bg" (OuterVolumeSpecName: "kube-api-access-tc7bg") pod "baa56398-d202-4968-82d2-b81cc5563f0f" (UID: "baa56398-d202-4968-82d2-b81cc5563f0f"). InnerVolumeSpecName "kube-api-access-tc7bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:51:09.238447 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.238436    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa56398-d202-4968-82d2-b81cc5563f0f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "baa56398-d202-4968-82d2-b81cc5563f0f" (UID: "baa56398-d202-4968-82d2-b81cc5563f0f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:51:09.337268 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.337202    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc7bg\" (UniqueName: \"kubernetes.io/projected/baa56398-d202-4968-82d2-b81cc5563f0f-kube-api-access-tc7bg\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:51:09.337268 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.337222    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/baa56398-d202-4968-82d2-b81cc5563f0f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:51:09.337268 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.337231    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/baa56398-d202-4968-82d2-b81cc5563f0f-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:51:09.911811 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.911779    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:51:09.952254 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.952218    2567 generic.go:356] "Generic (PLEG): container finished" podID="baa56398-d202-4968-82d2-b81cc5563f0f" containerID="09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7" exitCode=0
Jul 01 18:51:09.952367 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.952273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" event={"ID":"baa56398-d202-4968-82d2-b81cc5563f0f","Type":"ContainerDied","Data":"09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7"}
Jul 01 18:51:09.952367 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.952293    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"
Jul 01 18:51:09.952367 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.952329    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq" event={"ID":"baa56398-d202-4968-82d2-b81cc5563f0f","Type":"ContainerDied","Data":"b33f239a0ea9b7714e4715d00a4b1bd63c8fe4b22d8cb4a538092212ec0324a8"}
Jul 01 18:51:09.952367 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.952342    2567 scope.go:117] "RemoveContainer" containerID="969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99"
Jul 01 18:51:09.960118 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.960084    2567 scope.go:117] "RemoveContainer" containerID="09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7"
Jul 01 18:51:09.966881 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.966862    2567 scope.go:117] "RemoveContainer" containerID="969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99"
Jul 01 18:51:09.967171 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:51:09.967144    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99\": container with ID starting with 969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99 not found: ID does not exist" containerID="969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99"
Jul 01 18:51:09.967277 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.967185    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99"} err="failed to get container status \"969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99\": rpc error: code = NotFound desc = could not find container \"969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99\": container with ID starting with 969e61e301da71c0174fd6707fbb620b36a77925abdd1223de85791763fa4c99 not found: ID does not exist"
Jul 01 18:51:09.967277 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.967208    2567 scope.go:117] "RemoveContainer" containerID="09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7"
Jul 01 18:51:09.967854 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:51:09.967828    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7\": container with ID starting with 09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7 not found: ID does not exist" containerID="09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7"
Jul 01 18:51:09.967854 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.967857    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7"} err="failed to get container status \"09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7\": rpc error: code = NotFound desc = could not find container \"09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7\": container with ID starting with 09ecf9f211e2ba2d68558def7bb68562c73585d129a1d00d2fa31256969126a7 not found: ID does not exist"
Jul 01 18:51:09.969433 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.969416    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"]
Jul 01 18:51:09.973451 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:09.973432    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1f8d1-predictor-6f4bc64b9d-2dvmq"]
Jul 01 18:51:11.426828 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:11.426804    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" path="/var/lib/kubelet/pods/baa56398-d202-4968-82d2-b81cc5563f0f/volumes"
Jul 01 18:51:14.911590 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:14.911551    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:51:19.911690 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:19.911656    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:51:19.912045 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:19.911749    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:51:24.911089 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:24.911015    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:51:29.911340 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:29.911305    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:51:31.678165 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:31.678142    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:51:31.683947 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:31.683925    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:51:31.684225 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:31.684211    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:51:31.689767 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:31.689753    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:51:34.910945 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:34.910913    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:51:37.063517 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:37.063493    2567 generic.go:356] "Generic (PLEG): container finished" podID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerID="cc95cf6f94cd816ba2923e65657e65cbada2c6528f5e89451ac33c5a3b41317b" exitCode=0
Jul 01 18:51:37.063772 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:37.063548    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" event={"ID":"08cb8d05-b37a-45df-bcc0-614a25013f98","Type":"ContainerDied","Data":"cc95cf6f94cd816ba2923e65657e65cbada2c6528f5e89451ac33c5a3b41317b"}
Jul 01 18:51:37.679549 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:37.679522    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:51:37.734036 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:37.734017    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cb8d05-b37a-45df-bcc0-614a25013f98-openshift-service-ca-bundle\") pod \"08cb8d05-b37a-45df-bcc0-614a25013f98\" (UID: \"08cb8d05-b37a-45df-bcc0-614a25013f98\") "
Jul 01 18:51:37.734141 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:37.734109    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08cb8d05-b37a-45df-bcc0-614a25013f98-proxy-tls\") pod \"08cb8d05-b37a-45df-bcc0-614a25013f98\" (UID: \"08cb8d05-b37a-45df-bcc0-614a25013f98\") "
Jul 01 18:51:37.734361 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:37.734343    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08cb8d05-b37a-45df-bcc0-614a25013f98-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "08cb8d05-b37a-45df-bcc0-614a25013f98" (UID: "08cb8d05-b37a-45df-bcc0-614a25013f98"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:51:37.735829 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:37.735804    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08cb8d05-b37a-45df-bcc0-614a25013f98-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "08cb8d05-b37a-45df-bcc0-614a25013f98" (UID: "08cb8d05-b37a-45df-bcc0-614a25013f98"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:51:37.835448 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:37.835396    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08cb8d05-b37a-45df-bcc0-614a25013f98-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:51:37.835448 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:37.835416    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/08cb8d05-b37a-45df-bcc0-614a25013f98-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:51:38.068852 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:38.068836    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"
Jul 01 18:51:38.069201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:38.068887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t" event={"ID":"08cb8d05-b37a-45df-bcc0-614a25013f98","Type":"ContainerDied","Data":"c1ff11ac5b399820b96e847cb6c4bd25553c952a09a8e63c6775da65d4746f7f"}
Jul 01 18:51:38.069201 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:38.068958    2567 scope.go:117] "RemoveContainer" containerID="cc95cf6f94cd816ba2923e65657e65cbada2c6528f5e89451ac33c5a3b41317b"
Jul 01 18:51:38.090028 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:38.089983    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"]
Jul 01 18:51:38.094089 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:38.094073    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1f8d1-76dfc65fbc-hs22t"]
Jul 01 18:51:39.426772 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:51:39.426746    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" path="/var/lib/kubelet/pods/08cb8d05-b37a-45df-bcc0-614a25013f98/volumes"
Jul 01 18:55:12.322940 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:55:12.322904    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:56:31.703922 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:56:31.703895    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:56:31.709621 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:56:31.709599    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:56:31.710499 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:56:31.710480    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:56:31.715873 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:56:31.715854    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:58:57.142488 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.142421    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"]
Jul 01 18:58:57.142999 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.142622    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085" containerID="cri-o://5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328" gracePeriod=30
Jul 01 18:58:57.195908 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.195881    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:58:57.308146 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.308123    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"]
Jul 01 18:58:57.308375 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.308335    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container" containerID="cri-o://cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb" gracePeriod=30
Jul 01 18:58:57.308477 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.308353    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kube-rbac-proxy" containerID="cri-o://f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c" gracePeriod=30
Jul 01 18:58:57.335552 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.335531    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:58:57.402485 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.402428    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:58:57.858192 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.858166    2567 generic.go:356] "Generic (PLEG): container finished" podID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerID="f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c" exitCode=2
Jul 01 18:58:57.858352 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:57.858250    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" event={"ID":"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e","Type":"ContainerDied","Data":"f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c"}
Jul 01 18:58:58.144505 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:58.144429    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:58:58.244197 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:58.244157    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:58:59.552443 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.552423    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:58:59.690956 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.690897    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-rbac-proxy-sar-config\") pod \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") "
Jul 01 18:58:59.691065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.690955    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-proxy-tls\") pod \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") "
Jul 01 18:58:59.691065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.690998    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdmmh\" (UniqueName: \"kubernetes.io/projected/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-api-access-cdmmh\") pod \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\" (UID: \"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e\") "
Jul 01 18:58:59.691206 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.691186    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" (UID: "56af3c3a-ceb8-4dad-9d0a-9cc3071b056e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:58:59.692700 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.692680    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" (UID: "56af3c3a-ceb8-4dad-9d0a-9cc3071b056e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:58:59.692800 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.692771    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-api-access-cdmmh" (OuterVolumeSpecName: "kube-api-access-cdmmh") pod "56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" (UID: "56af3c3a-ceb8-4dad-9d0a-9cc3071b056e"). InnerVolumeSpecName "kube-api-access-cdmmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 18:58:59.792370 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.792348    2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:58:59.792370 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.792369    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:58:59.792485 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.792379    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdmmh\" (UniqueName: \"kubernetes.io/projected/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e-kube-api-access-cdmmh\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:58:59.868055 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.868028    2567 generic.go:356] "Generic (PLEG): container finished" podID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerID="cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb" exitCode=0
Jul 01 18:58:59.868157 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.868077    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"
Jul 01 18:58:59.868200 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.868075    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" event={"ID":"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e","Type":"ContainerDied","Data":"cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb"}
Jul 01 18:58:59.868254 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.868211    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl" event={"ID":"56af3c3a-ceb8-4dad-9d0a-9cc3071b056e","Type":"ContainerDied","Data":"3c757d7d5152ac9f1587c1adf95c2ee988f1a8071632cb17973d1324ff55030a"}
Jul 01 18:58:59.868292 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.868254    2567 scope.go:117] "RemoveContainer" containerID="f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c"
Jul 01 18:58:59.876030 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.876014    2567 scope.go:117] "RemoveContainer" containerID="cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb"
Jul 01 18:58:59.882740 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.882724    2567 scope.go:117] "RemoveContainer" containerID="f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c"
Jul 01 18:58:59.882967 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:58:59.882953    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c\": container with ID starting with f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c not found: ID does not exist" containerID="f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c"
Jul 01 18:58:59.883008 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.882973    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c"} err="failed to get container status \"f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c\": rpc error: code = NotFound desc = could not find container \"f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c\": container with ID starting with f846d613a80739b5561369feac54a71305dacf36343ebe63bc522711ff4e052c not found: ID does not exist"
Jul 01 18:58:59.883008 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.882987    2567 scope.go:117] "RemoveContainer" containerID="cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb"
Jul 01 18:58:59.883216 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:58:59.883198    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb\": container with ID starting with cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb not found: ID does not exist" containerID="cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb"
Jul 01 18:58:59.883283 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.883222    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb"} err="failed to get container status \"cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb\": rpc error: code = NotFound desc = could not find container \"cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb\": container with ID starting with cfb52d22f0320db463e1140bf0d5ccf251d83f29716faecb46d80a721bf453cb not found: ID does not exist"
Jul 01 18:58:59.889210 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.889192    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"]
Jul 01 18:58:59.893385 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:58:59.893367    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-60085-predictor-5b6dd5d96d-gltrl"]
Jul 01 18:59:00.848129 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:00.848094    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:59:01.426468 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:01.426444    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" path="/var/lib/kubelet/pods/56af3c3a-ceb8-4dad-9d0a-9cc3071b056e/volumes"
Jul 01 18:59:05.848136 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:05.848088    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:59:10.848176 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:10.848140    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:59:10.848549 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:10.848225    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:59:13.449515 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:13.449481    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:14.291667 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:14.291645    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:15.117645 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:15.117625    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:15.847860 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:15.847830    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:59:15.928223 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:15.928195    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:16.721254 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:16.721215    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:17.562305 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:17.562284    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:18.375588 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:18.375567    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:19.212028 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:19.211983    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:20.048079 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:20.048046    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:20.848042 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:20.848014    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:59:20.870817 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:20.870776    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:21.665938 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:21.665919    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:22.475380 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:22.475345    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:23.312005 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:23.311979    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:24.129672 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:24.129644    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-60085-86b755c89-djvlx_3066e176-0337-4751-a566-a7995aac8c14/switch-graph-60085/0.log"
Jul 01 18:59:25.847520 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:25.847489    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 01 18:59:27.288654 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.288632    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:59:27.381483 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.381460    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3066e176-0337-4751-a566-a7995aac8c14-openshift-service-ca-bundle\") pod \"3066e176-0337-4751-a566-a7995aac8c14\" (UID: \"3066e176-0337-4751-a566-a7995aac8c14\") "
Jul 01 18:59:27.381593 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.381519    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3066e176-0337-4751-a566-a7995aac8c14-proxy-tls\") pod \"3066e176-0337-4751-a566-a7995aac8c14\" (UID: \"3066e176-0337-4751-a566-a7995aac8c14\") "
Jul 01 18:59:27.381807 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.381781    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3066e176-0337-4751-a566-a7995aac8c14-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3066e176-0337-4751-a566-a7995aac8c14" (UID: "3066e176-0337-4751-a566-a7995aac8c14"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 18:59:27.383288 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.383269    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3066e176-0337-4751-a566-a7995aac8c14-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3066e176-0337-4751-a566-a7995aac8c14" (UID: "3066e176-0337-4751-a566-a7995aac8c14"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 18:59:27.482150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.482127    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3066e176-0337-4751-a566-a7995aac8c14-openshift-service-ca-bundle\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:59:27.482150 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.482148    2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3066e176-0337-4751-a566-a7995aac8c14-proxy-tls\") on node \"ip-10-0-136-171.ec2.internal\" DevicePath \"\""
Jul 01 18:59:27.980781 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.980757    2567 generic.go:356] "Generic (PLEG): container finished" podID="3066e176-0337-4751-a566-a7995aac8c14" containerID="5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328" exitCode=0
Jul 01 18:59:27.980982 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.980798    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"
Jul 01 18:59:27.980982 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.980836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" event={"ID":"3066e176-0337-4751-a566-a7995aac8c14","Type":"ContainerDied","Data":"5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328"}
Jul 01 18:59:27.980982 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.980888    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx" event={"ID":"3066e176-0337-4751-a566-a7995aac8c14","Type":"ContainerDied","Data":"d8ee474658992ffd3244fd72431de1db152cd9372ad1cb538f2ee92ae1a9d240"}
Jul 01 18:59:27.980982 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.980929    2567 scope.go:117] "RemoveContainer" containerID="5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328"
Jul 01 18:59:27.988865 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.988847    2567 scope.go:117] "RemoveContainer" containerID="5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328"
Jul 01 18:59:27.989097 ip-10-0-136-171 kubenswrapper[2567]: E0701 18:59:27.989080    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328\": container with ID starting with 5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328 not found: ID does not exist" containerID="5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328"
Jul 01 18:59:27.989164 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.989109    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328"} err="failed to get container status \"5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328\": rpc error: code = NotFound desc = could not find container \"5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328\": container with ID starting with 5d4d90864cb108816ca65e47e446a05940545888ae74ba5ad182698d892f5328 not found: ID does not exist"
Jul 01 18:59:27.997651 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.997617    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"]
Jul 01 18:59:27.999887 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:27.999867    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-60085-86b755c89-djvlx"]
Jul 01 18:59:29.425825 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.425800    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3066e176-0337-4751-a566-a7995aac8c14" path="/var/lib/kubelet/pods/3066e176-0337-4751-a566-a7995aac8c14/volumes"
Jul 01 18:59:29.690525 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.690464    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:59:29.826007 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.825985    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lpb44/must-gather-wcw6f"]
Jul 01 18:59:29.826351 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826336    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container"
Jul 01 18:59:29.826431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826353    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container"
Jul 01 18:59:29.826431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826371    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085"
Jul 01 18:59:29.826431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826380    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085"
Jul 01 18:59:29.826431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826395    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1"
Jul 01 18:59:29.826431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826403    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1"
Jul 01 18:59:29.826431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826417    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kube-rbac-proxy"
Jul 01 18:59:29.826431 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826425    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kube-rbac-proxy"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826442    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kube-rbac-proxy"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826450    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kube-rbac-proxy"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826465    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826474    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826549    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kube-rbac-proxy"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826563    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="08cb8d05-b37a-45df-bcc0-614a25013f98" containerName="splitter-graph-1f8d1"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826570    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kserve-container"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826578    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa56398-d202-4968-82d2-b81cc5563f0f" containerName="kube-rbac-proxy"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826590    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3066e176-0337-4751-a566-a7995aac8c14" containerName="switch-graph-60085"
Jul 01 18:59:29.826764 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.826599    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56af3c3a-ceb8-4dad-9d0a-9cc3071b056e" containerName="kserve-container"
Jul 01 18:59:29.831140 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.831123    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lpb44/must-gather-wcw6f"
Jul 01 18:59:29.833633 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.833614    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lpb44\"/\"default-dockercfg-gczn5\""
Jul 01 18:59:29.833633 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.833627    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lpb44\"/\"kube-root-ca.crt\""
Jul 01 18:59:29.833768 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.833633    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lpb44\"/\"openshift-service-ca.crt\""
Jul 01 18:59:29.838160 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.837685    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lpb44/must-gather-wcw6f"]
Jul 01 18:59:29.842602 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.842585    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:59:29.898009 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.897992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee761477-7c31-4ff8-980c-ee21364ffcad-must-gather-output\") pod \"must-gather-wcw6f\" (UID: \"ee761477-7c31-4ff8-980c-ee21364ffcad\") " pod="openshift-must-gather-lpb44/must-gather-wcw6f"
Jul 01 18:59:29.898097 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.898054    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2crqx\" (UniqueName: \"kubernetes.io/projected/ee761477-7c31-4ff8-980c-ee21364ffcad-kube-api-access-2crqx\") pod \"must-gather-wcw6f\" (UID: \"ee761477-7c31-4ff8-980c-ee21364ffcad\") " pod="openshift-must-gather-lpb44/must-gather-wcw6f"
Jul 01 18:59:29.942834 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.942789    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:59:29.998590 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.998570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2crqx\" (UniqueName: \"kubernetes.io/projected/ee761477-7c31-4ff8-980c-ee21364ffcad-kube-api-access-2crqx\") pod \"must-gather-wcw6f\" (UID: \"ee761477-7c31-4ff8-980c-ee21364ffcad\") " pod="openshift-must-gather-lpb44/must-gather-wcw6f"
Jul 01 18:59:29.998672 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.998606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee761477-7c31-4ff8-980c-ee21364ffcad-must-gather-output\") pod \"must-gather-wcw6f\" (UID: \"ee761477-7c31-4ff8-980c-ee21364ffcad\") " pod="openshift-must-gather-lpb44/must-gather-wcw6f"
Jul 01 18:59:29.998829 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:29.998816    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee761477-7c31-4ff8-980c-ee21364ffcad-must-gather-output\") pod \"must-gather-wcw6f\" (UID: \"ee761477-7c31-4ff8-980c-ee21364ffcad\") " pod="openshift-must-gather-lpb44/must-gather-wcw6f"
Jul 01 18:59:30.006145 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:30.006122    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2crqx\" (UniqueName: \"kubernetes.io/projected/ee761477-7c31-4ff8-980c-ee21364ffcad-kube-api-access-2crqx\") pod \"must-gather-wcw6f\" (UID: \"ee761477-7c31-4ff8-980c-ee21364ffcad\") " pod="openshift-must-gather-lpb44/must-gather-wcw6f"
Jul 01 18:59:30.150614 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:30.150592    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lpb44/must-gather-wcw6f"
Jul 01 18:59:30.274042 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:30.274016    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lpb44/must-gather-wcw6f"]
Jul 01 18:59:30.276738 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:59:30.276713    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee761477_7c31_4ff8_980c_ee21364ffcad.slice/crio-733186640f8dea9d63fc6905b64485a49d5b60d326d608a56f09ab84e69a00a7 WatchSource:0}: Error finding container 733186640f8dea9d63fc6905b64485a49d5b60d326d608a56f09ab84e69a00a7: Status 404 returned error can't find the container with id 733186640f8dea9d63fc6905b64485a49d5b60d326d608a56f09ab84e69a00a7
Jul 01 18:59:30.278616 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:30.278602    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 18:59:30.995726 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:30.995695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lpb44/must-gather-wcw6f" event={"ID":"ee761477-7c31-4ff8-980c-ee21364ffcad","Type":"ContainerStarted","Data":"733186640f8dea9d63fc6905b64485a49d5b60d326d608a56f09ab84e69a00a7"}
Jul 01 18:59:32.004038 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:32.003947    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lpb44/must-gather-wcw6f" event={"ID":"ee761477-7c31-4ff8-980c-ee21364ffcad","Type":"ContainerStarted","Data":"08b7ad52622c95e35cc7c0f5a55c85eacaa22882baf537c99b8d06fae78e0e0c"}
Jul 01 18:59:32.004455 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:32.004075    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lpb44/must-gather-wcw6f" event={"ID":"ee761477-7c31-4ff8-980c-ee21364ffcad","Type":"ContainerStarted","Data":"d0db6f1076e6e352c2b0e9548eefae3553d95026e4a75d77353bf3144afffe90"}
Jul 01 18:59:32.020668 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:32.020612    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lpb44/must-gather-wcw6f" podStartSLOduration=2.274193328 podStartE2EDuration="3.020598783s" totalImagesPullingTime="746.405455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:59:32.019720627 +0000 UTC m=+3181.249793479" watchObservedRunningTime="2026-07-01 18:59:32.020598783 +0000 UTC m=+3181.250671614"
Jul 01 18:59:32.411310 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:32.411281    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4hhs2_75251e3f-b5d0-4ba0-8ccf-9af0898a0b09/global-pull-secret-syncer/0.log"
Jul 01 18:59:32.663095 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:32.663029    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log"
Jul 01 18:59:32.839255 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:32.839218    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-171.ec2.internal_b0d496fb63956da7a6ed47cfee6c9f2e/haproxy/0.log"
Jul 01 18:59:35.468422 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:35.468384    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:59:35.554400 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:35.554363    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stdmb_31142a55-0cf1-4ec1-aecb-625cf095258f/konnectivity-agent/0.log" limit=1024
Jul 01 18:59:35.783268 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:35.781412    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_135f0700-d087-4871-8834-f07049fccf3f/alertmanager/0.log"
Jul 01 18:59:35.832213 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:35.832170    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_135f0700-d087-4871-8834-f07049fccf3f/config-reloader/0.log"
Jul 01 18:59:35.879494 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:35.879459    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_135f0700-d087-4871-8834-f07049fccf3f/kube-rbac-proxy-web/0.log"
Jul 01 18:59:35.924369 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:35.924346    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_135f0700-d087-4871-8834-f07049fccf3f/kube-rbac-proxy/0.log"
Jul 01 18:59:35.963407 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:35.963375    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_135f0700-d087-4871-8834-f07049fccf3f/kube-rbac-proxy-metric/0.log"
Jul 01 18:59:36.001039 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:36.001008    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_135f0700-d087-4871-8834-f07049fccf3f/prom-label-proxy/0.log"
Jul 01 18:59:36.056364 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:36.056293    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_135f0700-d087-4871-8834-f07049fccf3f/init-config-reloader/0.log"
Jul 01 18:59:36.262169 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:36.262144    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-577f5d66d7-jm5nk_c0f4fe70-afb6-45b8-9908-da23eec74e2a/metrics-server/0.log"
Jul 01 18:59:36.308035 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:36.307969    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-c28jf_e0f954d4-23af-43f9-bf7e-c008c7654407/monitoring-plugin/0.log"
Jul 01 18:59:36.607053 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:36.606979    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ssnpd_6666bc99-8078-4c9d-a07a-7d86a47b04f2/node-exporter/0.log"
Jul 01 18:59:36.644817 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:36.644777    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ssnpd_6666bc99-8078-4c9d-a07a-7d86a47b04f2/kube-rbac-proxy/0.log"
Jul 01 18:59:36.682029 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:36.682008    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ssnpd_6666bc99-8078-4c9d-a07a-7d86a47b04f2/init-textfile/0.log"
Jul 01 18:59:37.083765 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:37.083732    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d795b4686-ptg44_21e22463-e2a6-413f-9a5c-dc13825c4dd6/telemeter-client/0.log"
Jul 01 18:59:37.113792 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:37.113760    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d795b4686-ptg44_21e22463-e2a6-413f-9a5c-dc13825c4dd6/reload/0.log"
Jul 01 18:59:37.137450 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:37.137426    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d795b4686-ptg44_21e22463-e2a6-413f-9a5c-dc13825c4dd6/kube-rbac-proxy/0.log"
Jul 01 18:59:39.109299 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.109273    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/2.log"
Jul 01 18:59:39.116575 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.116550    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-4f67x_007fc588-afb3-4c42-b282-e1204664a892/console-operator/3.log"
Jul 01 18:59:39.523753 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.523724    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68f55f76f5-pm7xs_bed88497-794d-4270-ae0a-caad013043e0/console/0.log"
Jul 01 18:59:39.562896 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.562867    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-6z6tc_3626e7d7-094b-401e-b782-3f81c75981cd/download-server/0.log"
Jul 01 18:59:39.880217 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.880179    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"]
Jul 01 18:59:39.886116 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.886087    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:39.896649 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.896615    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"]
Jul 01 18:59:39.997976 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.997947    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-sys\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:39.997976 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.997981    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-podres\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:39.998183 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.998000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-proc\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:39.998183 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.998021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-lib-modules\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:39.998279 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:39.998173    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzg5l\" (UniqueName: \"kubernetes.io/projected/36118910-0a0b-4a65-a384-25335531b71d-kube-api-access-mzg5l\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.095948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.095918    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-h72lg_01cf60b3-0ec9-420e-9ba9-751f019fa20e/volume-data-source-validator/0.log"
Jul 01 18:59:40.099375 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.099353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-sys\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.099511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.099380    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-podres\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.099511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.099397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-proc\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.099511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.099411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-lib-modules\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.099511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.099450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzg5l\" (UniqueName: \"kubernetes.io/projected/36118910-0a0b-4a65-a384-25335531b71d-kube-api-access-mzg5l\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.099511 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.099479    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-sys\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.099716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.099510    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-proc\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.099716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.099519    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-podres\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.099716 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.099560    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36118910-0a0b-4a65-a384-25335531b71d-lib-modules\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.106747 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.106726    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzg5l\" (UniqueName: \"kubernetes.io/projected/36118910-0a0b-4a65-a384-25335531b71d-kube-api-access-mzg5l\") pod \"perf-node-gather-daemonset-jcz2w\" (UID: \"36118910-0a0b-4a65-a384-25335531b71d\") " pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.201571 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.201485    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:40.352662 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:40.352632    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"]
Jul 01 18:59:40.355196 ip-10-0-136-171 kubenswrapper[2567]: W0701 18:59:40.355162    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36118910_0a0b_4a65_a384_25335531b71d.slice/crio-1de60225a9da49525d1bb191c4e44d15e31cffb65c02763414975bc94c119536 WatchSource:0}: Error finding container 1de60225a9da49525d1bb191c4e44d15e31cffb65c02763414975bc94c119536: Status 404 returned error can't find the container with id 1de60225a9da49525d1bb191c4e44d15e31cffb65c02763414975bc94c119536
Jul 01 18:59:41.045065 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.045037    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cwwp4_6f70f713-2706-4b59-ba5d-6969e783e7ab/dns/0.log"
Jul 01 18:59:41.060151 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.060106    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w" event={"ID":"36118910-0a0b-4a65-a384-25335531b71d","Type":"ContainerStarted","Data":"c43cbf32ba5e6360d58ea33f2c96701eb6233b32eb04aaea4845637c57fbc983"}
Jul 01 18:59:41.060364 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.060169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w" event={"ID":"36118910-0a0b-4a65-a384-25335531b71d","Type":"ContainerStarted","Data":"1de60225a9da49525d1bb191c4e44d15e31cffb65c02763414975bc94c119536"}
Jul 01 18:59:41.060444 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.060373    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:41.068628 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.068601    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cwwp4_6f70f713-2706-4b59-ba5d-6969e783e7ab/kube-rbac-proxy/0.log"
Jul 01 18:59:41.080397 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.080352    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w" podStartSLOduration=2.080331709 podStartE2EDuration="2.080331709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:59:41.078354992 +0000 UTC m=+3190.308427826" watchObservedRunningTime="2026-07-01 18:59:41.080331709 +0000 UTC m=+3190.310404543"
Jul 01 18:59:41.168400 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.168368    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gq6w6_c1d599f9-956d-4ac5-81c3-c1b9351e30a8/dns-node-resolver/0.log"
Jul 01 18:59:41.628454 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.628408    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c5fd87dc5-n9rqm_4f8fc377-e916-4921-b08f-5ecb467d5f6d/registry/0.log"
Jul 01 18:59:41.644007 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.643982    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c5fd87dc5-n9rqm_4f8fc377-e916-4921-b08f-5ecb467d5f6d/registry/1.log"
Jul 01 18:59:41.671053 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:41.671004    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-28ftw_cd95642d-fd67-4914-8f8e-2a1b1efd9e99/node-ca/0.log"
Jul 01 18:59:42.848803 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:42.848773    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9wd2p_0a4a5924-1af3-4547-ac01-f9b9c2261553/serve-healthcheck-canary/0.log"
Jul 01 18:59:43.232068 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:43.232001    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-pcmfc_1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09/insights-operator/0.log"
Jul 01 18:59:43.234365 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:43.234346    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-pcmfc_1f4ecdb7-dfd0-41ea-85c9-6f767d80bd09/insights-operator/1.log"
Jul 01 18:59:43.321864 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:43.321841    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nzwm7_b5ef3552-54c2-4c01-91e5-bd8ad74a0503/kube-rbac-proxy/0.log"
Jul 01 18:59:43.342220 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:43.342198    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nzwm7_b5ef3552-54c2-4c01-91e5-bd8ad74a0503/exporter/0.log"
Jul 01 18:59:43.362631 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:43.362606    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nzwm7_b5ef3552-54c2-4c01-91e5-bd8ad74a0503/extractor/0.log"
Jul 01 18:59:45.320069 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:45.320041    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-776d68c7c4-bbn6r_e517cca7-6d7a-422e-a71d-149891864036/manager/0.log"
Jul 01 18:59:45.380532 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:45.380511    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-qp752_9d1e23f0-63a9-4fe3-8d7f-a11e09f5ed43/server/0.log"
Jul 01 18:59:45.633268 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:45.633183    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-9ch95_5046151c-dd5e-44ee-8bb6-7bf7034f7b9d/seaweedfs/0.log"
Jul 01 18:59:47.077948 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:47.077918    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lpb44/perf-node-gather-daemonset-jcz2w"
Jul 01 18:59:50.028766 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:50.028735    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-wrcrn_dba92742-325f-4d75-9e60-aa6550511df1/kube-storage-version-migrator-operator/1.log"
Jul 01 18:59:50.029497 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:50.029477    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-wrcrn_dba92742-325f-4d75-9e60-aa6550511df1/kube-storage-version-migrator-operator/0.log"
Jul 01 18:59:51.298921 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.298894    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xhs4g_3da39a8b-9978-4ebf-9f87-f2387c65185e/kube-multus-additional-cni-plugins/0.log"
Jul 01 18:59:51.323483 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.323455    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xhs4g_3da39a8b-9978-4ebf-9f87-f2387c65185e/egress-router-binary-copy/0.log"
Jul 01 18:59:51.345426 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.345405    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xhs4g_3da39a8b-9978-4ebf-9f87-f2387c65185e/cni-plugins/0.log"
Jul 01 18:59:51.368294 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.368274    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xhs4g_3da39a8b-9978-4ebf-9f87-f2387c65185e/bond-cni-plugin/0.log"
Jul 01 18:59:51.389572 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.389550    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xhs4g_3da39a8b-9978-4ebf-9f87-f2387c65185e/routeoverride-cni/0.log"
Jul 01 18:59:51.410982 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.410936    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xhs4g_3da39a8b-9978-4ebf-9f87-f2387c65185e/whereabouts-cni-bincopy/0.log"
Jul 01 18:59:51.433374 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.433358    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xhs4g_3da39a8b-9978-4ebf-9f87-f2387c65185e/whereabouts-cni/0.log"
Jul 01 18:59:51.530328 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.530302    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z5vlp_eb5cdfe3-5fa7-4404-8cc3-fb0b7ae5944b/kube-multus/0.log"
Jul 01 18:59:51.599682 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.599662    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ccl99_bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb/network-metrics-daemon/0.log"
Jul 01 18:59:51.619067 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:51.619051    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ccl99_bf3c45c1-f13f-43b5-a2d0-20a89c37c9cb/kube-rbac-proxy/0.log"
Jul 01 18:59:52.409724 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:52.409699    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-controller/0.log"
Jul 01 18:59:52.428748 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:52.428723    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/0.log"
Jul 01 18:59:52.430861 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:52.430840    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovn-acl-logging/1.log"
Jul 01 18:59:52.453192 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:52.453172    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/kube-rbac-proxy-node/0.log"
Jul 01 18:59:52.493537 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:52.493519    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/kube-rbac-proxy-ovn-metrics/0.log"
Jul 01 18:59:52.515085 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:52.515063    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/northd/0.log"
Jul 01 18:59:52.557828 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:52.557809    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/nbdb/0.log"
Jul 01 18:59:52.581177 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:52.581161    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/sbdb/0.log"
Jul 01 18:59:52.629277 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:52.629233    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kc7vf_6b052a40-d97e-4085-a2b3-8ab15e1e87f0/ovnkube-controller/0.log"
Jul 01 18:59:54.088227 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:54.088189    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56499946bc-xhl25_c0ba9fdb-456b-4f04-9906-ce72a74e10da/check-endpoints/0.log"
Jul 01 18:59:54.111059 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:54.111039    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-h84lh_ab32ca0a-ddca-440f-8ec3-1344e2586896/network-check-target-container/0.log"
Jul 01 18:59:55.066649 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:55.066597    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cpbss_a790c2fc-ab73-4563-ba30-750c24832b46/iptables-alerter/0.log"
Jul 01 18:59:55.834851 ip-10-0-136-171 kubenswrapper[2567]: I0701 18:59:55.834823    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4xrhm_38b432e2-719c-43e1-b685-fa97ebd5ad32/tuned/0.log"