Jul 08 16:34:02.322840 ip-10-0-129-12 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 16:34:02.789571 ip-10-0-129-12 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 16:34:02.789571 ip-10-0-129-12 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 16:34:02.789571 ip-10-0-129-12 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 16:34:02.789571 ip-10-0-129-12 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 16:34:02.789571 ip-10-0-129-12 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 16:34:02.792013 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.791911    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 16:34:02.799506 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799482    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:02.799506 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799502    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:02.799506 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799506    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:02.799506 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799509    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:02.799506 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799512    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:02.799506 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799514    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:02.799506 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799517    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799523    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799526    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799528    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799531    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799535    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799537    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799540    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799542    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799545    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799547    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799550    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799552    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799555    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799557    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799560    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799563    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799565    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799575    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799578    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:02.799763 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799580    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799583    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799585    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799588    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799590    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799592    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799595    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799598    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799600    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799603    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799605    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799608    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799611    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799614    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799619    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799624    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799627    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799630    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799634    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:02.800222 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799641    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799644    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799648    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799650    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799654    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799656    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799659    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799661    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799664    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799666    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799670    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799672    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799675    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799678    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799681    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799683    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799686    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799688    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799691    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799694    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:02.800683 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799696    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799699    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799701    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799704    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799706    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799708    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799711    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799716    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799720    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799723    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799725    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799728    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799730    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799733    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799735    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799738    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799740    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799743    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799745    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:02.801190 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799747    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799750    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799753    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799755    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799758    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799761    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799764    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799766    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799769    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799772    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799774    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799777    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799780    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799782    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.799785    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801494    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801504    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801507    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801510    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801513    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:02.801661 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801515    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801518    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801521    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801523    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801526    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801530    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801533    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801536    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801539    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801542    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801544    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801547    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801550    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801552    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801555    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801557    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801560    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801562    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801565    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:02.802118 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801569    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801571    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801574    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801577    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801581    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801584    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801586    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801589    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801592    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801594    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801597    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801600    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801603    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801606    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801608    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801611    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801613    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801616    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801618    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801621    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:02.802607 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801623    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801625    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801628    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801630    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801633    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801636    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801639    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801642    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801644    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801647    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801649    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801652    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801654    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801657    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801659    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801661    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801666    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801669    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801673    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801676    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:02.803085 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801678    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801681    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801683    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801686    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801688    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801691    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801693    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801696    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801698    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801700    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801703    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801705    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801707    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801710    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801712    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801715    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801717    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801720    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801722    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801724    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:02.803595 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801727    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801730    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801732    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801735    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801738    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801740    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801743    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801745    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801748    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801751    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801753    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801755    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801758    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801760    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.801762    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802142    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802146    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802148    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802151    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802153    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:02.804065 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802156    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802159    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802161    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802164    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802166    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802169    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802171    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802173    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802176    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802178    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802181    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802184    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802186    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802189    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802192    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802194    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802197    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802200    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802203    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802205    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:02.804562 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802208    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802210    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802213    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802215    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802218    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802220    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802222    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802225    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802227    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802229    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802232    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802234    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802236    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802239    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802241    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802243    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802245    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802248    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802250    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:02.805026 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802253    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802256    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802259    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802262    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802265    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802268    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802270    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802273    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802275    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802277    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802280    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802282    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802285    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802287    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802290    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802292    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802294    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802297    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802300    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:02.805520 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802302    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802305    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802307    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802309    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802311    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802314    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802317    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802319    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802323    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802327    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802330    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802333    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802336    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802338    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802341    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802343    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802346    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802348    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802350    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802353    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:02.805972 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802355    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802357    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802361    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802365    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802367    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802371    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802374    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802377    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802380    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802382    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802384    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802386    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802389    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802391    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802393    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.802396    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802482    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802490    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802496    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802501    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 16:34:02.806448 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802505    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802508    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802512    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802520    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802523    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802526    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802530    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802533    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802536    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802539    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802541    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802544    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802547    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802550    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802554    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802557    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802560    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802563    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802566    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802571    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802574    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802577    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802580    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802583    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 16:34:02.806922 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802586    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802588    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802591    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802594    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802598    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802601    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802604    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802606    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802609    2583 flags.go:64] FLAG: --enable-server="true"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802612    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802616    2583 flags.go:64] FLAG: --event-burst="100"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802622    2583 flags.go:64] FLAG: --event-qps="50"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802625    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802627    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802630    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802634    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802637    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802639    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802643    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802645    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802648    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802651    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802653    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802656    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802659    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 16:34:02.807488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802662    2583 flags.go:64] FLAG: --feature-gates=""
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802666    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802668    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802672    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802675    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802677    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802680    2583 flags.go:64] FLAG: --help="false"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802683    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-129-12.ec2.internal"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802685    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802688    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802691    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802694    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802697    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802700    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802703    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802705    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802708    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802711    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802715    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802718    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802720    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802723    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802726    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802729    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 16:34:02.808091 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802732    2583 flags.go:64] FLAG: --lock-file=""
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802734    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802737    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802740    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802745    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802747    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802750    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802753    2583 flags.go:64] FLAG: --logging-format="text"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802755    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802759    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802761    2583 flags.go:64] FLAG: --manifest-url=""
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802764    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802769    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802772    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802776    2583 flags.go:64] FLAG: --max-pods="110"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802778    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802781    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802784    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802786    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802789    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802792    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802794    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802801    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802804    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802807    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 16:34:02.808722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802810    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802814    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802819    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802822    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802825    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802827    2583 flags.go:64] FLAG: --port="10250"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802830    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802834    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04974c5bab4cd752c"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802837    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802840    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802843    2583 flags.go:64] FLAG: --register-node="true"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802846    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802849    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802852    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802855    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802857    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802861    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802864    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802867    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802869    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802873    2583 flags.go:64] FLAG: --runonce="false"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802875    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802878    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802881    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802884    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 16:34:02.809407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802887    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802889    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802892    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802895    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802898    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802900    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802903    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802906    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802908    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802912    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802915    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802920    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802922    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802925    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802931    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802934    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802937    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802939    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802942    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802945    2583 flags.go:64] FLAG: --v="2"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802948    2583 flags.go:64] FLAG: --version="false"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802952    2583 flags.go:64] FLAG: --vmodule=""
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802956    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.802959    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803072    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:02.810411 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803075    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803078    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803081    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803084    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803086    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803089    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803091    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803094    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803097    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803100    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803102    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803104    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803107    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803110    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803114    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803116    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803120    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803122    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803124    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803127    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:02.811029 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803129    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803133    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803136    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803138    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803140    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803143    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803145    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803147    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803149    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803152    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803154    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803156    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803159    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803161    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803163    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803166    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803169    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803171    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803174    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803176    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:02.811537 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803178    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803180    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803183    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803185    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803187    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803189    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803191    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803194    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803196    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803199    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803201    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803203    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803206    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803210    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803212    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803214    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803217    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803219    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803221    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803224    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:02.812093 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803226    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803228    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803230    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803233    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803235    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803238    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803240    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803242    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803244    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803247    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803250    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803252    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803254    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803256    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803258    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803261    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803263    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803265    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803267    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803270    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:02.812603 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803272    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803274    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803277    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803279    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803281    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803285    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803287    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803291    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803294    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803297    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803300    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803302    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803305    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803308    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803310    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803314    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803317    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:02.813090 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.803319    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.803325    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.811680    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.811700    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.812361    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.812369    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812435    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812441    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812444    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812448    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812467    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812470    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812473    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812476    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812478    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:02.813550 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812481    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812483    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812485    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812488    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812490    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812493    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812495    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812498    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812500    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812503    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812505    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812511    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812514    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812516    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812519    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812521    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812524    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812527    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812529    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:02.813905 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812531    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812534    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812537    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812539    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812542    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812545    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812547    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812550    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812552    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812554    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812558    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812561    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812563    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812566    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812568    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812571    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812573    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812576    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812578    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812580    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:02.814368 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812583    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812586    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812588    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812591    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812593    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812596    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812598    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812601    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812603    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812606    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812609    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812613    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812618    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812620    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812623    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812625    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812628    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812630    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812633    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:02.814884 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812635    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812637    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812641    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812645    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812648    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812651    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812653    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812655    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812658    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812660    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812663    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812665    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812668    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812671    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812673    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812675    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812678    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812681    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812683    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:02.815324 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812686    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812688    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812690    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812693    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812696    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812698    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812701    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812704    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812706    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812708    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812711    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812713    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812716    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.812721    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812841    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:02.815796 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812845    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812848    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812851    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812853    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812856    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812858    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812861    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812863    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812866    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812868    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812871    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812874    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812876    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812879    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812881    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812883    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812887    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812889    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812892    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812894    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:02.816149 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812896    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812899    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812902    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812905    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812908    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812911    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812914    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812917    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812920    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812923    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812926    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812929    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812932    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812934    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812937    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812939    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812942    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812944    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812947    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:02.816650 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812949    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812951    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812954    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812956    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812958    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812961    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812963    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812966    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812969    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812971    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812974    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812976    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812978    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812980    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812983    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812985    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812988    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812990    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812992    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812994    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:02.817095 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812997    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.812999    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813001    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813004    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813006    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813008    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813012    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813015    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813018    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813021    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813023    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813026    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813028    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813031    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813034    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813036    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813038    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813041    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813044    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813047    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:02.817632 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813049    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813051    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813054    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813056    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813058    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813061    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813064    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813066    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813069    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813071    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813074    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813076    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813078    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813081    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813083    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813085    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813088    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813090    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:02.818125 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:02.813093    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:02.818573 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.813098    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 16:34:02.818573 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.813238    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 16:34:02.818573 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.815499    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 16:34:02.818573 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.816882    2583 server.go:1019] "Starting client certificate rotation"
Jul 08 16:34:02.818573 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.816985    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 16:34:02.818573 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.817024    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 16:34:02.820156 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.820140    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 16:34:02.821339 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.821318    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 16:34:02.831882 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.831862    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 08 16:34:02.833977 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.833961    2583 log.go:25] "Validated CRI v1 image API"
Jul 08 16:34:02.834780 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.834756    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 16:34:02.840141 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.840122    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 886b5526-faeb-4020-95bf-62060afd9dcf:/dev/nvme0n1p3 a00c5762-d8f1-485c-8951-65c0906b76f9:/dev/nvme0n1p4]
Jul 08 16:34:02.840220 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.840141    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 16:34:02.844664 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.844646    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 16:34:02.848403 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.848287    2583 manager.go:216] Machine: {Timestamp:2026-07-08 16:34:02.846533785 +0000 UTC m=+0.390886926 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3188838 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cf3c8ca2bf7d75db0bccad59e8077 SystemUUID:ec2cf3c8-ca2b-f7d7-5db0-bccad59e8077 BootID:0f45ac58-cf52-429d-89ac-a8f06827f024 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:be:85:99:0c:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:be:85:99:0c:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:2a:e6:79:29:5b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 16:34:02.848403 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.848391    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 16:34:02.848546 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.848493    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 16:34:02.852007 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.851975    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 16:34:02.852146 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.852011    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 16:34:02.852733 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.852723    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 16:34:02.852763 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.852735    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 16:34:02.852763 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.852742    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 16:34:02.852763 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.852756    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 16:34:02.854037 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.854027    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 16:34:02.856624 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.856613    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 16:34:02.856749 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.856739    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 16:34:02.856787 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.856771    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 16:34:02.856787 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.856781    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 16:34:02.856859 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.856794    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 16:34:02.856859 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.856804    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 08 16:34:02.856859 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.856813    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 16:34:02.857216 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.857201    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 16:34:02.857261 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.857227    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 16:34:02.859909 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.859893    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 16:34:02.862740 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.862724    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 16:34:02.862828 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.862761    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 16:34:02.864506 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864492    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864510    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864519    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864526    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864536    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864544    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864555    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864562    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864574    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864582    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 16:34:02.864592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864594    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 16:34:02.864861 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.864603    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 16:34:02.866061 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.866044    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 16:34:02.866061 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.866062    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 16:34:02.868192 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.868173    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 16:34:02.868268 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.868195    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 16:34:02.868268 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.868197    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 16:34:02.869623 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.869610    2583 server.go:1268] "Started kubelet"
Jul 08 16:34:02.869692 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.869666    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 16:34:02.869754 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.869698    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 16:34:02.869798 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.869784    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 16:34:02.870525 ip-10-0-129-12 systemd[1]: Started Kubernetes Kubelet.
Jul 08 16:34:02.871058 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.870820    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 16:34:02.872818 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.872803    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 16:34:02.876862 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.876841    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 16:34:02.879108 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.877864    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-12.ec2.internal.18c05dab540c05f0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-12.ec2.internal,UID:ip-10-0-129-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-12.ec2.internal,},FirstTimestamp:2026-07-08 16:34:02.869581296 +0000 UTC m=+0.413934494,LastTimestamp:2026-07-08 16:34:02.869581296 +0000 UTC m=+0.413934494,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-12.ec2.internal,}"
Jul 08 16:34:02.880336 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.880321    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 16:34:02.880336 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.880324    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 16:34:02.880467 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.880428    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:02.881103 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881082    2583 factory.go:55] Registering systemd factory
Jul 08 16:34:02.881199 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881127    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 08 16:34:02.881376 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881356    2583 factory.go:153] Registering CRI-O factory
Jul 08 16:34:02.881376 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881375    2583 factory.go:223] Registration of the crio container factory successfully
Jul 08 16:34:02.881541 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881402    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 16:34:02.881541 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881405    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 16:34:02.881541 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881420    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 16:34:02.881541 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881484    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 16:34:02.881541 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881512    2583 factory.go:103] Registering Raw factory
Jul 08 16:34:02.881541 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881526    2583 manager.go:1196] Started watching for new ooms in manager
Jul 08 16:34:02.881777 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881592    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 16:34:02.881777 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.881599    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 16:34:02.883469 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.883417    2583 manager.go:349] Starting recovery of all containers
Jul 08 16:34:02.886661 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.886340    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 16:34:02.886661 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.886520    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 16:34:02.896254 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.896075    2583 manager.go:354] Recovery completed
Jul 08 16:34:02.900464 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.900437    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:02.902237 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.902220    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:02.902289 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.902250    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:02.902289 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.902261    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:02.902769 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.902755    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 16:34:02.902769 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.902769    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 16:34:02.902868 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.902786    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 16:34:02.902868 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.902760    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:02.903633 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.903618    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:02.903698 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.903645    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:02.903698 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.903657    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:02.903989 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.903965    2583 policy_none.go:49] "None policy: Start"
Jul 08 16:34:02.903989 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.903985    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 16:34:02.904089 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.903996    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 16:34:02.904089 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.903960    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-12.ec2.internal.18c05dab55fe4efd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-12.ec2.internal,UID:ip-10-0-129-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-12.ec2.internal,},FirstTimestamp:2026-07-08 16:34:02.902236925 +0000 UTC m=+0.446590064,LastTimestamp:2026-07-08 16:34:02.902236925 +0000 UTC m=+0.446590064,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-12.ec2.internal,}"
Jul 08 16:34:02.905003 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.904992    2583 policy_none.go:47] "Start"
Jul 08 16:34:02.913046 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.912983    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-12.ec2.internal.18c05dab55fe961b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-12.ec2.internal,UID:ip-10-0-129-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-12.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-12.ec2.internal,},FirstTimestamp:2026-07-08 16:34:02.902255131 +0000 UTC m=+0.446608271,LastTimestamp:2026-07-08 16:34:02.902255131 +0000 UTC m=+0.446608271,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-12.ec2.internal,}"
Jul 08 16:34:02.918309 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.918253    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k9rmf"
Jul 08 16:34:02.926730 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.926710    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k9rmf"
Jul 08 16:34:02.928515 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.927358    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-12.ec2.internal.18c05dab55febaf1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-12.ec2.internal,UID:ip-10-0-129-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-12.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-12.ec2.internal,},FirstTimestamp:2026-07-08 16:34:02.902264561 +0000 UTC m=+0.446617700,LastTimestamp:2026-07-08 16:34:02.902264561 +0000 UTC m=+0.446617700,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-12.ec2.internal,}"
Jul 08 16:34:02.937512 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.937495    2583 manager.go:337] "Starting Device Plugin manager"
Jul 08 16:34:02.937633 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.937529    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 16:34:02.937633 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.937540    2583 server.go:87] "Starting device plugin registration server"
Jul 08 16:34:02.937819 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.937803    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 16:34:02.937882 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.937819    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 16:34:02.937931 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.937913    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 16:34:02.938005 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.937986    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 16:34:02.938005 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.937993    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 16:34:02.938566 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.938545    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 16:34:02.938655 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.938591    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:02.998080 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.998043    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 16:34:02.999437 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.999420    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 16:34:02.999518 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.999477    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 16:34:02.999518 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:02.999499    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 16:34:02.999594 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:02.999540    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 16:34:03.001399 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.001380    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:03.038534 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.038500    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:03.039953 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.039900    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:03.039953 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.039931    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:03.039953 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.039942    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:03.040138 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.039978    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.046040 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.046021    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.046140 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.046050    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-12.ec2.internal\": node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.069268 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.069236    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.100434 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.100400    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"]
Jul 08 16:34:03.100639 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.100500    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:03.102311 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.102297    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:03.102401 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.102330    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:03.102401 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.102343    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:03.103560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.103545    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:03.103665 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.103650    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.103709 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.103683    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:03.104242 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.104230    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:03.104316 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.104235    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:03.104316 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.104277    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:03.104316 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.104287    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:03.104420 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.104258    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:03.104420 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.104343    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:03.106127 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.106114    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.106174 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.106143    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:03.106814 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.106797    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:03.106899 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.106829    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:03.106899 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.106844    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:03.132300 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.132272    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-12.ec2.internal\" not found" node="ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.135730 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.135715    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-12.ec2.internal\" not found" node="ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.169846 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.169821    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.182950 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.182922    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01502c7c24216826a0dc843b8111a65b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"01502c7c24216826a0dc843b8111a65b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.183052 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.182957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.183052 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.183003    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.270116 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.270074    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.283534 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.283504    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.283618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.283538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.283618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.283596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01502c7c24216826a0dc843b8111a65b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"01502c7c24216826a0dc843b8111a65b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.283710 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.283624    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.283710 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.283660    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.283710 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.283664    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01502c7c24216826a0dc843b8111a65b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"01502c7c24216826a0dc843b8111a65b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.371000 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.370923    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.435550 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.435512    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.439270 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.439177    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.472066 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.472038    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.572606 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.572572    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.673237 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.673170    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.773994 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.773968    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.816588 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.816544    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 16:34:03.817179 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.816697    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 16:34:03.861659 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.861633    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:03.874065 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:03.874033    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 08 16:34:03.931860 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.931787    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 16:29:03 +0000 UTC" deadline="2028-01-27 23:49:26.159931237 +0000 UTC"
Jul 08 16:34:03.931860 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.931827    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13639h15m22.228107775s"
Jul 08 16:34:03.966502 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.966444    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:03.981429 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.981389    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:03.991579 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.991555    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 16:34:03.993449 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:03.993429    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 08 16:34:04.006343 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.006320    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 16:34:04.030870 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:04.030834    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc010214d8710e456690b884b961bbc6a.slice/crio-96a2fee7bac3271ed6f0efe7248e67f98bba23d2965e5fb2eabd5b5239e935af WatchSource:0}: Error finding container 96a2fee7bac3271ed6f0efe7248e67f98bba23d2965e5fb2eabd5b5239e935af: Status 404 returned error can't find the container with id 96a2fee7bac3271ed6f0efe7248e67f98bba23d2965e5fb2eabd5b5239e935af
Jul 08 16:34:04.036791 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.036775    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:34:04.091509 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:04.091482    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01502c7c24216826a0dc843b8111a65b.slice/crio-9926c3c0723d934b93a063831f060b9fee29a03aece4418f0cdd1f03fc8d47a9 WatchSource:0}: Error finding container 9926c3c0723d934b93a063831f060b9fee29a03aece4418f0cdd1f03fc8d47a9: Status 404 returned error can't find the container with id 9926c3c0723d934b93a063831f060b9fee29a03aece4418f0cdd1f03fc8d47a9
Jul 08 16:34:04.245694 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.245616    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:04.857861 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.857823    2583 apiserver.go:52] "Watching apiserver"
Jul 08 16:34:04.867666 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.867618    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 16:34:04.868078 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.868045    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-wcwmf","openshift-image-registry/node-ca-b2tlm","openshift-multus/network-metrics-daemon-bmrdj","openshift-network-operator/iptables-alerter-wjh28","kube-system/global-pull-secret-syncer-mt9kk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh","openshift-dns/node-resolver-pkbl5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal","openshift-multus/multus-8m7pv","openshift-multus/multus-additional-cni-plugins-z9n4x","openshift-network-diagnostics/network-check-target-6ltj4","openshift-ovn-kubernetes/ovnkube-node-6db6r","kube-system/konnectivity-agent-qwhr9","kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"]
Jul 08 16:34:04.869756 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.869736    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:04.870970 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.870944    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:04.872410 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.872388    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 16:34:04.872767 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.872744    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 16:34:04.872910 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.872890    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qztvz\""
Jul 08 16:34:04.873731 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.873713    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 16:34:04.873820 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.873795    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jrnql\""
Jul 08 16:34:04.874095 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.874080    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 16:34:04.875276 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.875241    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:04.875363 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:04.875317    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:04.876267 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.876244    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:04.877413 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.877368    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:04.877492 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:04.877434    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:04.878525 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.878502    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.879650 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.879633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.880337 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.880321    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 16:34:04.880337 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.880330    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:34:04.880470 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.880385    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vvnmm\""
Jul 08 16:34:04.880743 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.880728    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 16:34:04.880944 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.880927    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 16:34:04.881003 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.880965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.882090 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.881723    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r9kqb\""
Jul 08 16:34:04.882090 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.881940    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 16:34:04.883512 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.883180    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 16:34:04.883618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.883519    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 16:34:04.884178 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.884156    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:04.884274 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.884226    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 16:34:04.884516 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.884479    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:34:04.884851 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.884833    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rz62j\""
Jul 08 16:34:04.884928 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.884872    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 16:34:04.885066 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.885052    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lqszb\""
Jul 08 16:34:04.885285 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.885269    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 16:34:04.885644 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.885625    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 16:34:04.885949 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.885921    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 16:34:04.886745 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.886726    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:04.886983 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.886957    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 16:34:04.887148 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.887133    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 16:34:04.887205 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.887188    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wg2vj\""
Jul 08 16:34:04.887406 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.887391    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 16:34:04.888007 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.887989    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:04.888091 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:04.888070    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:04.889151 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.889138    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.889469 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.889280    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 16:34:04.889469 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.889357    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 16:34:04.889469 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.889422    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gpjbp\""
Jul 08 16:34:04.891580 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.891562    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mg2dt\""
Jul 08 16:34:04.891886 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.891870    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 16:34:04.892372 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-dbus\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:04.892455 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-socket-dir-parent\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.892455 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-var-lib-cni-multus\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.892455 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892416    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd7393d7-c4dd-40de-b68e-f8e154affeb7-host-slash\") pod \"iptables-alerter-wjh28\" (UID: \"cd7393d7-c4dd-40de-b68e-f8e154affeb7\") " pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:04.892455 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.892712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892465    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-var-lib-kubelet\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.892712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:04.892712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-cni-dir\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.892712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892599    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-daemon-config\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.892712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-kubelet-config\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:04.892712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-hostroot\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.892712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-modprobe-d\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.892712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892673    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-sys\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.892712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ba94bac-d099-4adc-9ba5-fcaf01ee5f74-host\") pod \"node-ca-b2tlm\" (UID: \"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74\") " pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892739    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-registration-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892764    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd3aa765-2529-4fd1-824a-6324b48f7528-tmp\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892791    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/872e618a-29c3-405e-8e90-5bff364e11a4-konnectivity-ca\") pod \"konnectivity-agent-qwhr9\" (UID: \"872e618a-29c3-405e-8e90-5bff364e11a4\") " pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892814    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-run-k8s-cni-cncf-io\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-var-lib-kubelet\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892861    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2k6\" (UniqueName: \"kubernetes.io/projected/2165d4c2-a77d-4b76-b474-95315fb06fd7-kube-api-access-pj2k6\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-sysconfig\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892953    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-tuned\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-cnibin\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.892995    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd7393d7-c4dd-40de-b68e-f8e154affeb7-iptables-alerter-script\") pod \"iptables-alerter-wjh28\" (UID: \"cd7393d7-c4dd-40de-b68e-f8e154affeb7\") " pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-system-cni-dir\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2165d4c2-a77d-4b76-b474-95315fb06fd7-cni-binary-copy\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-run-netns\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hgwb\" (UniqueName: \"kubernetes.io/projected/d21075da-88bf-4f11-9b38-383dfd9c16e2-kube-api-access-2hgwb\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.893453 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-kubernetes\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-sysctl-conf\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-host\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jsn2\" (UniqueName: \"kubernetes.io/projected/85e37108-b3e5-43a9-803f-a409ced780e4-kube-api-access-5jsn2\") pod \"node-resolver-pkbl5\" (UID: \"85e37108-b3e5-43a9-803f-a409ced780e4\") " pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893198    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-etc-kubernetes\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-device-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893243    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893251    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-run\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9b4x\" (UniqueName: \"kubernetes.io/projected/bd3aa765-2529-4fd1-824a-6324b48f7528-kube-api-access-z9b4x\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-sys-fs\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893310    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-565ts\" (UniqueName: \"kubernetes.io/projected/3ba94bac-d099-4adc-9ba5-fcaf01ee5f74-kube-api-access-565ts\") pod \"node-ca-b2tlm\" (UID: \"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74\") " pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893347    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-os-release\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893354    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893384    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-var-lib-cni-bin\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-conf-dir\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893471    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-lib-modules\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893537    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85e37108-b3e5-43a9-803f-a409ced780e4-hosts-file\") pod \"node-resolver-pkbl5\" (UID: \"85e37108-b3e5-43a9-803f-a409ced780e4\") " pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:04.894032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e37108-b3e5-43a9-803f-a409ced780e4-tmp-dir\") pod \"node-resolver-pkbl5\" (UID: \"85e37108-b3e5-43a9-803f-a409ced780e4\") " pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:04.894618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:04.894618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-sysctl-d\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.894618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893634    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/872e618a-29c3-405e-8e90-5bff364e11a4-agent-certs\") pod \"konnectivity-agent-qwhr9\" (UID: \"872e618a-29c3-405e-8e90-5bff364e11a4\") " pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:04.894618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893673    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-socket-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.894618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-systemd\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.894618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ba94bac-d099-4adc-9ba5-fcaf01ee5f74-serviceca\") pod \"node-ca-b2tlm\" (UID: \"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74\") " pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:04.894618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrk5\" (UniqueName: \"kubernetes.io/projected/cd7393d7-c4dd-40de-b68e-f8e154affeb7-kube-api-access-sxrk5\") pod \"iptables-alerter-wjh28\" (UID: \"cd7393d7-c4dd-40de-b68e-f8e154affeb7\") " pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:04.894618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-run-multus-certs\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.894618 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.893794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjksz\" (UniqueName: \"kubernetes.io/projected/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-kube-api-access-vjksz\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:04.899899 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.899880    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 16:34:04.929261 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.929237    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cktrp"
Jul 08 16:34:04.937909 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.937882    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cktrp"
Jul 08 16:34:04.983306 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.983269    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 16:34:04.994003 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.993968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2165d4c2-a77d-4b76-b474-95315fb06fd7-cni-binary-copy\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.994171 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-run-netns\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.994171 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hgwb\" (UniqueName: \"kubernetes.io/projected/d21075da-88bf-4f11-9b38-383dfd9c16e2-kube-api-access-2hgwb\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.994171 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-kubernetes\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.994171 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-sysctl-conf\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.994171 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994119    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-host\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.994171 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994137    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-system-cni-dir\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:04.994171 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-var-lib-openvswitch\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jsn2\" (UniqueName: \"kubernetes.io/projected/85e37108-b3e5-43a9-803f-a409ced780e4-kube-api-access-5jsn2\") pod \"node-resolver-pkbl5\" (UID: \"85e37108-b3e5-43a9-803f-a409ced780e4\") " pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994206    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-cnibin\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994271    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-etc-kubernetes\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-device-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994341    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-run\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9b4x\" (UniqueName: \"kubernetes.io/projected/bd3aa765-2529-4fd1-824a-6324b48f7528-kube-api-access-z9b4x\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-run-systemd\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-sys-fs\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994419    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-565ts\" (UniqueName: \"kubernetes.io/projected/3ba94bac-d099-4adc-9ba5-fcaf01ee5f74-kube-api-access-565ts\") pod \"node-ca-b2tlm\" (UID: \"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74\") " pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-systemd-units\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6a36d7e-2412-4a90-9cf8-4713b45ac268-ovnkube-script-lib\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-os-release\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-var-lib-cni-bin\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-conf-dir\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.994561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-lib-modules\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85e37108-b3e5-43a9-803f-a409ced780e4-hosts-file\") pod \"node-resolver-pkbl5\" (UID: \"85e37108-b3e5-43a9-803f-a409ced780e4\") " pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e37108-b3e5-43a9-803f-a409ced780e4-tmp-dir\") pod \"node-resolver-pkbl5\" (UID: \"85e37108-b3e5-43a9-803f-a409ced780e4\") " pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994682    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-sysctl-d\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/872e618a-29c3-405e-8e90-5bff364e11a4-agent-certs\") pod \"konnectivity-agent-qwhr9\" (UID: \"872e618a-29c3-405e-8e90-5bff364e11a4\") " pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-socket-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-systemd\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ba94bac-d099-4adc-9ba5-fcaf01ee5f74-serviceca\") pod \"node-ca-b2tlm\" (UID: \"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74\") " pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-kubelet\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994829    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-slash\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994846    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrk5\" (UniqueName: \"kubernetes.io/projected/cd7393d7-c4dd-40de-b68e-f8e154affeb7-kube-api-access-sxrk5\") pod \"iptables-alerter-wjh28\" (UID: \"cd7393d7-c4dd-40de-b68e-f8e154affeb7\") " pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-cni-bin\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-cni-netd\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6a36d7e-2412-4a90-9cf8-4713b45ac268-ovnkube-config\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-os-release\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:04.995132 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.994992    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56996789-2cf7-4141-9898-ecd9eef72b7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-run-multus-certs\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjksz\" (UniqueName: \"kubernetes.io/projected/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-kube-api-access-vjksz\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995100    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-etc-openvswitch\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-run-ovn\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-run-ovn-kubernetes\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6a36d7e-2412-4a90-9cf8-4713b45ac268-ovn-node-metrics-cert\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-dbus\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-socket-dir-parent\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-var-lib-cni-multus\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995253    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd7393d7-c4dd-40de-b68e-f8e154affeb7-host-slash\") pod \"iptables-alerter-wjh28\" (UID: \"cd7393d7-c4dd-40de-b68e-f8e154affeb7\") " pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995269    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995293    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-var-lib-kubelet\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-node-log\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-cni-dir\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.995778 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-daemon-config\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-run-openvswitch\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995480    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6a36d7e-2412-4a90-9cf8-4713b45ac268-env-overrides\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-kubelet-config\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-hostroot\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995569    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-modprobe-d\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-sys\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ba94bac-d099-4adc-9ba5-fcaf01ee5f74-host\") pod \"node-ca-b2tlm\" (UID: \"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74\") " pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56996789-2cf7-4141-9898-ecd9eef72b7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56996789-2cf7-4141-9898-ecd9eef72b7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-registration-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995691    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd3aa765-2529-4fd1-824a-6324b48f7528-tmp\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-run-netns\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-log-socket\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/872e618a-29c3-405e-8e90-5bff364e11a4-konnectivity-ca\") pod \"konnectivity-agent-qwhr9\" (UID: \"872e618a-29c3-405e-8e90-5bff364e11a4\") " pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-run-k8s-cni-cncf-io\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-var-lib-kubelet\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.996356 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2k6\" (UniqueName: \"kubernetes.io/projected/2165d4c2-a77d-4b76-b474-95315fb06fd7-kube-api-access-pj2k6\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995926    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-sysconfig\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-tuned\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-cnibin\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd7393d7-c4dd-40de-b68e-f8e154affeb7-iptables-alerter-script\") pod \"iptables-alerter-wjh28\" (UID: \"cd7393d7-c4dd-40de-b68e-f8e154affeb7\") " pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.995991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljld7\" (UniqueName: \"kubernetes.io/projected/a6a36d7e-2412-4a90-9cf8-4713b45ac268-kube-api-access-ljld7\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.996016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2gnl\" (UniqueName: \"kubernetes.io/projected/56996789-2cf7-4141-9898-ecd9eef72b7e-kube-api-access-t2gnl\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.996048    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.996082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-system-cni-dir\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.996204    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-system-cni-dir\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.996759    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2165d4c2-a77d-4b76-b474-95315fb06fd7-cni-binary-copy\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.996960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.996849    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-run-netns\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.997347 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.997129    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-kubernetes\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.997347 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.997259    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-sysctl-conf\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.997347 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.997300    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-host\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.999560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.997607    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-var-lib-cni-multus\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.999560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.997607    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-etc-kubernetes\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.999560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.997670    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-dbus\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:04.999560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.997683    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd7393d7-c4dd-40de-b68e-f8e154affeb7-host-slash\") pod \"iptables-alerter-wjh28\" (UID: \"cd7393d7-c4dd-40de-b68e-f8e154affeb7\") " pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:04.999560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.997676    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-socket-dir-parent\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:04.999560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.998838    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-device-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:04.999560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.998887    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-run\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:04.999560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.999176    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85e37108-b3e5-43a9-803f-a409ced780e4-hosts-file\") pod \"node-resolver-pkbl5\" (UID: \"85e37108-b3e5-43a9-803f-a409ced780e4\") " pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:04.999560 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:04.999483    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e37108-b3e5-43a9-803f-a409ced780e4-tmp-dir\") pod \"node-resolver-pkbl5\" (UID: \"85e37108-b3e5-43a9-803f-a409ced780e4\") " pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:05.000429 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.000391    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:05.000545 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.000450    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:05.003862 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.002904    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.004098    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-socket-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.004186    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-sys-fs\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.005100    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-os-release\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.005173    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-var-lib-cni-bin\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.005219    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-conf-dir\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.005336    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-lib-modules\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.005397    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-systemd\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.005873    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ba94bac-d099-4adc-9ba5-fcaf01ee5f74-serviceca\") pod \"node-ca-b2tlm\" (UID: \"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74\") " pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.006272    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-run-multus-certs\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.006695    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-var-lib-kubelet\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.006806    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.006883    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret podName:a7b09743-c5b0-4b1e-82e3-37c9e8e09146 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:05.506867542 +0000 UTC m=+3.051220670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret") pod "global-pull-secret-syncer-mt9kk" (UID: "a7b09743-c5b0-4b1e-82e3-37c9e8e09146") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.007174    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-cni-dir\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.007756    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2165d4c2-a77d-4b76-b474-95315fb06fd7-multus-daemon-config\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.007851    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-sysconfig\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.008443    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-cnibin\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.008996    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd7393d7-c4dd-40de-b68e-f8e154affeb7-iptables-alerter-script\") pod \"iptables-alerter-wjh28\" (UID: \"cd7393d7-c4dd-40de-b68e-f8e154affeb7\") " pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:05.009349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.009095    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d21075da-88bf-4f11-9b38-383dfd9c16e2-registration-dir\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:05.010257 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.009428    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/872e618a-29c3-405e-8e90-5bff364e11a4-agent-certs\") pod \"konnectivity-agent-qwhr9\" (UID: \"872e618a-29c3-405e-8e90-5bff364e11a4\") " pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:05.010257 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.009554    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:05.010257 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.009628    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs podName:e1dfe72b-45e2-4611-afd4-f5a04fe89fbc nodeName:}" failed. No retries permitted until 2026-07-08 16:34:05.509608652 +0000 UTC m=+3.053961782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs") pod "network-metrics-daemon-bmrdj" (UID: "e1dfe72b-45e2-4611-afd4-f5a04fe89fbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:05.010400 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.010379    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9b4x\" (UniqueName: \"kubernetes.io/projected/bd3aa765-2529-4fd1-824a-6324b48f7528-kube-api-access-z9b4x\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.011457 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.010668    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-hostroot\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.011457 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.010763    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-run-k8s-cni-cncf-io\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.011457 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.011096    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-modprobe-d\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.011457 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.011172    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-sys\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.011457 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.011286    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-sysctl-d\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.011457 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.011296    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/872e618a-29c3-405e-8e90-5bff364e11a4-konnectivity-ca\") pod \"konnectivity-agent-qwhr9\" (UID: \"872e618a-29c3-405e-8e90-5bff364e11a4\") " pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:05.011457 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.011319    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2165d4c2-a77d-4b76-b474-95315fb06fd7-host-var-lib-kubelet\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.011457 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.011397    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ba94bac-d099-4adc-9ba5-fcaf01ee5f74-host\") pod \"node-ca-b2tlm\" (UID: \"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74\") " pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:05.011920 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.011612    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hgwb\" (UniqueName: \"kubernetes.io/projected/d21075da-88bf-4f11-9b38-383dfd9c16e2-kube-api-access-2hgwb\") pod \"aws-ebs-csi-driver-node-srkjh\" (UID: \"d21075da-88bf-4f11-9b38-383dfd9c16e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:05.011920 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.011635    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-kubelet-config\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:05.011920 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.011838    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd3aa765-2529-4fd1-824a-6324b48f7528-etc-tuned\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.012797 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.012682    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jsn2\" (UniqueName: \"kubernetes.io/projected/85e37108-b3e5-43a9-803f-a409ced780e4-kube-api-access-5jsn2\") pod \"node-resolver-pkbl5\" (UID: \"85e37108-b3e5-43a9-803f-a409ced780e4\") " pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:05.012962 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.012938    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd3aa765-2529-4fd1-824a-6324b48f7528-tmp\") pod \"tuned-wcwmf\" (UID: \"bd3aa765-2529-4fd1-824a-6324b48f7528\") " pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.013437 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.013378    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" event={"ID":"01502c7c24216826a0dc843b8111a65b","Type":"ContainerStarted","Data":"9926c3c0723d934b93a063831f060b9fee29a03aece4418f0cdd1f03fc8d47a9"}
Jul 08 16:34:05.015411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.015379    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"c010214d8710e456690b884b961bbc6a","Type":"ContainerStarted","Data":"96a2fee7bac3271ed6f0efe7248e67f98bba23d2965e5fb2eabd5b5239e935af"}
Jul 08 16:34:05.016521 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.016491    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-565ts\" (UniqueName: \"kubernetes.io/projected/3ba94bac-d099-4adc-9ba5-fcaf01ee5f74-kube-api-access-565ts\") pod \"node-ca-b2tlm\" (UID: \"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74\") " pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:05.018902 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.018874    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjksz\" (UniqueName: \"kubernetes.io/projected/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-kube-api-access-vjksz\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:05.019633 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.019613    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2k6\" (UniqueName: \"kubernetes.io/projected/2165d4c2-a77d-4b76-b474-95315fb06fd7-kube-api-access-pj2k6\") pod \"multus-8m7pv\" (UID: \"2165d4c2-a77d-4b76-b474-95315fb06fd7\") " pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.021403 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.021379    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrk5\" (UniqueName: \"kubernetes.io/projected/cd7393d7-c4dd-40de-b68e-f8e154affeb7-kube-api-access-sxrk5\") pod \"iptables-alerter-wjh28\" (UID: \"cd7393d7-c4dd-40de-b68e-f8e154affeb7\") " pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:05.097278 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-system-cni-dir\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.097278 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-var-lib-openvswitch\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-cnibin\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-run-systemd\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-systemd-units\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6a36d7e-2412-4a90-9cf8-4713b45ac268-ovnkube-script-lib\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097387    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-system-cni-dir\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097405    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-cnibin\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097381    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-var-lib-openvswitch\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097415    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-run-systemd\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097448    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-systemd-units\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-kubelet\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-slash\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-cni-bin\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.097614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-cni-netd\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097630    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6a36d7e-2412-4a90-9cf8-4713b45ac268-ovnkube-config\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-os-release\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56996789-2cf7-4141-9898-ecd9eef72b7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-etc-openvswitch\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-run-ovn\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-run-ovn-kubernetes\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6a36d7e-2412-4a90-9cf8-4713b45ac268-ovn-node-metrics-cert\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-node-log\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-run-openvswitch\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097936    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6a36d7e-2412-4a90-9cf8-4713b45ac268-env-overrides\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56996789-2cf7-4141-9898-ecd9eef72b7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.097998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56996789-2cf7-4141-9898-ecd9eef72b7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-run-netns\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-log-socket\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098070    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6a36d7e-2412-4a90-9cf8-4713b45ac268-ovnkube-script-lib\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.098297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljld7\" (UniqueName: \"kubernetes.io/projected/a6a36d7e-2412-4a90-9cf8-4713b45ac268-kube-api-access-ljld7\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2gnl\" (UniqueName: \"kubernetes.io/projected/56996789-2cf7-4141-9898-ecd9eef72b7e-kube-api-access-t2gnl\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098137    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-run-ovn\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098178    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-kubelet\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098217    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-slash\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098357    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098403    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-cni-bin\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098439    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-run-ovn-kubernetes\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098445    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-cni-netd\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.098958    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6a36d7e-2412-4a90-9cf8-4713b45ac268-ovnkube-config\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099015    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-etc-openvswitch\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099759 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099254    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56996789-2cf7-4141-9898-ecd9eef72b7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.099759 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099321    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56996789-2cf7-4141-9898-ecd9eef72b7e-os-release\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.099759 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099359    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099759 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099463    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56996789-2cf7-4141-9898-ecd9eef72b7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.099759 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099480    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-node-log\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099759 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099522    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-run-openvswitch\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099759 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099595    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-log-socket\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099759 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099638    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6a36d7e-2412-4a90-9cf8-4713b45ac268-host-run-netns\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.099759 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099678    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56996789-2cf7-4141-9898-ecd9eef72b7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.100065 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.099802    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6a36d7e-2412-4a90-9cf8-4713b45ac268-env-overrides\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.101256 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.101233    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6a36d7e-2412-4a90-9cf8-4713b45ac268-ovn-node-metrics-cert\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.111228 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.111168    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:05.111228 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.111193    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:05.111228 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.111209    2583 projected.go:196] Error preparing data for projected volume kube-api-access-85jmw for pod openshift-network-diagnostics/network-check-target-6ltj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:05.111446 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.111282    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw podName:30ac66b0-607c-4ed9-bdb7-79065051bbb0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:05.611263428 +0000 UTC m=+3.155616575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-85jmw" (UniqueName: "kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw") pod "network-check-target-6ltj4" (UID: "30ac66b0-607c-4ed9-bdb7-79065051bbb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:05.113824 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.113802    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2gnl\" (UniqueName: \"kubernetes.io/projected/56996789-2cf7-4141-9898-ecd9eef72b7e-kube-api-access-t2gnl\") pod \"multus-additional-cni-plugins-z9n4x\" (UID: \"56996789-2cf7-4141-9898-ecd9eef72b7e\") " pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.113920 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.113857    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljld7\" (UniqueName: \"kubernetes.io/projected/a6a36d7e-2412-4a90-9cf8-4713b45ac268-kube-api-access-ljld7\") pod \"ovnkube-node-6db6r\" (UID: \"a6a36d7e-2412-4a90-9cf8-4713b45ac268\") " pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.180829 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.180549    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pkbl5"
Jul 08 16:34:05.189260 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.189235    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:05.192528 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:05.192491    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e37108_b3e5_43a9_803f_a409ced780e4.slice/crio-3e8682314deb7b3c1e1a7be571e10bd51a21dead3e1c3205d29c238941353b7d WatchSource:0}: Error finding container 3e8682314deb7b3c1e1a7be571e10bd51a21dead3e1c3205d29c238941353b7d: Status 404 returned error can't find the container with id 3e8682314deb7b3c1e1a7be571e10bd51a21dead3e1c3205d29c238941353b7d
Jul 08 16:34:05.198037 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.198015    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjh28"
Jul 08 16:34:05.202107 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.202082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh"
Jul 08 16:34:05.208543 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.208511    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8m7pv"
Jul 08 16:34:05.215278 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.215260    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wcwmf"
Jul 08 16:34:05.222700 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.222680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2tlm"
Jul 08 16:34:05.237261 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.237234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z9n4x"
Jul 08 16:34:05.243174 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.243156    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:05.322501 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.322449    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:05.602746 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.602660    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:05.602746 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.602722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:05.602927 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.602830    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:05.602927 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.602855    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:05.602927 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.602901    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs podName:e1dfe72b-45e2-4611-afd4-f5a04fe89fbc nodeName:}" failed. No retries permitted until 2026-07-08 16:34:06.602881761 +0000 UTC m=+4.147234892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs") pod "network-metrics-daemon-bmrdj" (UID: "e1dfe72b-45e2-4611-afd4-f5a04fe89fbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:05.602927 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.602916    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret podName:a7b09743-c5b0-4b1e-82e3-37c9e8e09146 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:06.602909925 +0000 UTC m=+4.147263052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret") pod "global-pull-secret-syncer-mt9kk" (UID: "a7b09743-c5b0-4b1e-82e3-37c9e8e09146") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:05.704048 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.704012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:05.704253 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.704151    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:05.704253 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.704172    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:05.704253 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.704185    2583 projected.go:196] Error preparing data for projected volume kube-api-access-85jmw for pod openshift-network-diagnostics/network-check-target-6ltj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:05.704253 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:05.704247    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw podName:30ac66b0-607c-4ed9-bdb7-79065051bbb0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:06.704227862 +0000 UTC m=+4.248581012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-85jmw" (UniqueName: "kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw") pod "network-check-target-6ltj4" (UID: "30ac66b0-607c-4ed9-bdb7-79065051bbb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:05.940926 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.940887    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:05 +0000 UTC" deadline="2027-12-11 15:51:18.951226477 +0000 UTC"
Jul 08 16:34:05.940926 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:05.940920    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12503h17m13.010310141s"
Jul 08 16:34:06.000580 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:06.000541    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:06.000738 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:06.000691    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:06.017894 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:06.017852    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pkbl5" event={"ID":"85e37108-b3e5-43a9-803f-a409ced780e4","Type":"ContainerStarted","Data":"3e8682314deb7b3c1e1a7be571e10bd51a21dead3e1c3205d29c238941353b7d"}
Jul 08 16:34:06.251304 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:06.251276    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7393d7_c4dd_40de_b68e_f8e154affeb7.slice/crio-ecfe9aba3e431c13619dafbb24356ea38d5617a3b872d7a4d45b66bc8e8f413c WatchSource:0}: Error finding container ecfe9aba3e431c13619dafbb24356ea38d5617a3b872d7a4d45b66bc8e8f413c: Status 404 returned error can't find the container with id ecfe9aba3e431c13619dafbb24356ea38d5617a3b872d7a4d45b66bc8e8f413c
Jul 08 16:34:06.254707 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:06.254684    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3aa765_2529_4fd1_824a_6324b48f7528.slice/crio-702b5510f7cfc579d764da29e3977e58b7ac85fed815f6266b77ccf4b450e4ed WatchSource:0}: Error finding container 702b5510f7cfc579d764da29e3977e58b7ac85fed815f6266b77ccf4b450e4ed: Status 404 returned error can't find the container with id 702b5510f7cfc579d764da29e3977e58b7ac85fed815f6266b77ccf4b450e4ed
Jul 08 16:34:06.256658 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:06.256635    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba94bac_d099_4adc_9ba5_fcaf01ee5f74.slice/crio-aa2543a905a315a779af6b1d518c626aa48df0f8f9a1d39ef985fbcc38e92603 WatchSource:0}: Error finding container aa2543a905a315a779af6b1d518c626aa48df0f8f9a1d39ef985fbcc38e92603: Status 404 returned error can't find the container with id aa2543a905a315a779af6b1d518c626aa48df0f8f9a1d39ef985fbcc38e92603
Jul 08 16:34:06.257669 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:06.257646    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2165d4c2_a77d_4b76_b474_95315fb06fd7.slice/crio-0436eb6047b769fd5f0219953b05ecaef25acff07dba08f7bc50c9564ee75740 WatchSource:0}: Error finding container 0436eb6047b769fd5f0219953b05ecaef25acff07dba08f7bc50c9564ee75740: Status 404 returned error can't find the container with id 0436eb6047b769fd5f0219953b05ecaef25acff07dba08f7bc50c9564ee75740
Jul 08 16:34:06.258626 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:06.258602    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a36d7e_2412_4a90_9cf8_4713b45ac268.slice/crio-57d58f66e8479b5ca94373f2c03a36c429ebaa81857b42e5ba1ab1a7f1ca7099 WatchSource:0}: Error finding container 57d58f66e8479b5ca94373f2c03a36c429ebaa81857b42e5ba1ab1a7f1ca7099: Status 404 returned error can't find the container with id 57d58f66e8479b5ca94373f2c03a36c429ebaa81857b42e5ba1ab1a7f1ca7099
Jul 08 16:34:06.262282 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:06.261322    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56996789_2cf7_4141_9898_ecd9eef72b7e.slice/crio-31af58c93d68bfc8af86f2a753dc7ed4e88212a7f84f0fd1673b274845a56b0b WatchSource:0}: Error finding container 31af58c93d68bfc8af86f2a753dc7ed4e88212a7f84f0fd1673b274845a56b0b: Status 404 returned error can't find the container with id 31af58c93d68bfc8af86f2a753dc7ed4e88212a7f84f0fd1673b274845a56b0b
Jul 08 16:34:06.262282 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:06.261717    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21075da_88bf_4f11_9b38_383dfd9c16e2.slice/crio-c3486dc9e5ae103bfe783d210a2fcd9e605b65805847e23fe4770e1b8ceb9c86 WatchSource:0}: Error finding container c3486dc9e5ae103bfe783d210a2fcd9e605b65805847e23fe4770e1b8ceb9c86: Status 404 returned error can't find the container with id c3486dc9e5ae103bfe783d210a2fcd9e605b65805847e23fe4770e1b8ceb9c86
Jul 08 16:34:06.263233 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:06.262572    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872e618a_29c3_405e_8e90_5bff364e11a4.slice/crio-9f1d4f885623d96cae68f13c85f9db9fb93a5c251a1184767b331d4304d9e78f WatchSource:0}: Error finding container 9f1d4f885623d96cae68f13c85f9db9fb93a5c251a1184767b331d4304d9e78f: Status 404 returned error can't find the container with id 9f1d4f885623d96cae68f13c85f9db9fb93a5c251a1184767b331d4304d9e78f
Jul 08 16:34:06.611073 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:06.610821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:06.611249 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:06.611108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:06.611249 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:06.610999    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:06.611249 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:06.611231    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:06.611419 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:06.611236    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs podName:e1dfe72b-45e2-4611-afd4-f5a04fe89fbc nodeName:}" failed. No retries permitted until 2026-07-08 16:34:08.611216214 +0000 UTC m=+6.155569361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs") pod "network-metrics-daemon-bmrdj" (UID: "e1dfe72b-45e2-4611-afd4-f5a04fe89fbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:06.611419 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:06.611286    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret podName:a7b09743-c5b0-4b1e-82e3-37c9e8e09146 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:08.611272919 +0000 UTC m=+6.155626048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret") pod "global-pull-secret-syncer-mt9kk" (UID: "a7b09743-c5b0-4b1e-82e3-37c9e8e09146") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:06.711824 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:06.711778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:06.711994 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:06.711965    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:06.711994 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:06.711984    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:06.712091 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:06.711996    2583 projected.go:196] Error preparing data for projected volume kube-api-access-85jmw for pod openshift-network-diagnostics/network-check-target-6ltj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:06.712091 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:06.712052    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw podName:30ac66b0-607c-4ed9-bdb7-79065051bbb0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:08.712036772 +0000 UTC m=+6.256389905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-85jmw" (UniqueName: "kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw") pod "network-check-target-6ltj4" (UID: "30ac66b0-607c-4ed9-bdb7-79065051bbb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:06.941712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:06.941593    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:05 +0000 UTC" deadline="2028-01-01 09:00:43.947143865 +0000 UTC"
Jul 08 16:34:06.941712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:06.941660    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13000h26m37.005488339s"
Jul 08 16:34:07.002854 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.002820    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:07.003012 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:07.002956    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:07.003432 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.003410    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:07.003571 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:07.003548    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:07.020991 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.020956    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8m7pv" event={"ID":"2165d4c2-a77d-4b76-b474-95315fb06fd7","Type":"ContainerStarted","Data":"0436eb6047b769fd5f0219953b05ecaef25acff07dba08f7bc50c9564ee75740"}
Jul 08 16:34:07.023296 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.023227    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wcwmf" event={"ID":"bd3aa765-2529-4fd1-824a-6324b48f7528","Type":"ContainerStarted","Data":"702b5510f7cfc579d764da29e3977e58b7ac85fed815f6266b77ccf4b450e4ed"}
Jul 08 16:34:07.028491 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.027888    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" event={"ID":"01502c7c24216826a0dc843b8111a65b","Type":"ContainerStarted","Data":"d354e64e6bcda12eb266e327a2da5e704435f54fc7e36009a1a34f0cb49e3572"}
Jul 08 16:34:07.040911 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.040808    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh" event={"ID":"d21075da-88bf-4f11-9b38-383dfd9c16e2","Type":"ContainerStarted","Data":"c3486dc9e5ae103bfe783d210a2fcd9e605b65805847e23fe4770e1b8ceb9c86"}
Jul 08 16:34:07.052940 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.052845    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2tlm" event={"ID":"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74","Type":"ContainerStarted","Data":"aa2543a905a315a779af6b1d518c626aa48df0f8f9a1d39ef985fbcc38e92603"}
Jul 08 16:34:07.065989 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.065853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjh28" event={"ID":"cd7393d7-c4dd-40de-b68e-f8e154affeb7","Type":"ContainerStarted","Data":"ecfe9aba3e431c13619dafbb24356ea38d5617a3b872d7a4d45b66bc8e8f413c"}
Jul 08 16:34:07.069415 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.069387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qwhr9" event={"ID":"872e618a-29c3-405e-8e90-5bff364e11a4","Type":"ContainerStarted","Data":"9f1d4f885623d96cae68f13c85f9db9fb93a5c251a1184767b331d4304d9e78f"}
Jul 08 16:34:07.076582 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.076400    2583 generic.go:356] "Generic (PLEG): container finished" podID="c010214d8710e456690b884b961bbc6a" containerID="fa8a5398d4c0211fcddde285168328250e55c39adc286ede8eb7e32347bdf6ba" exitCode=0
Jul 08 16:34:07.076582 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.076479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"c010214d8710e456690b884b961bbc6a","Type":"ContainerDied","Data":"fa8a5398d4c0211fcddde285168328250e55c39adc286ede8eb7e32347bdf6ba"}
Jul 08 16:34:07.082993 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.082917    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9n4x" event={"ID":"56996789-2cf7-4141-9898-ecd9eef72b7e","Type":"ContainerStarted","Data":"31af58c93d68bfc8af86f2a753dc7ed4e88212a7f84f0fd1673b274845a56b0b"}
Jul 08 16:34:07.096740 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.096674    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" podStartSLOduration=3.096651173 podStartE2EDuration="3.096651173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:07.046440542 +0000 UTC m=+4.590793694" watchObservedRunningTime="2026-07-08 16:34:07.096651173 +0000 UTC m=+4.641004331"
Jul 08 16:34:07.097458 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.097425    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerStarted","Data":"57d58f66e8479b5ca94373f2c03a36c429ebaa81857b42e5ba1ab1a7f1ca7099"}
Jul 08 16:34:07.999891 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:07.999851    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:08.000465 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:08.000027    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:08.108439 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:08.108402    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"c010214d8710e456690b884b961bbc6a","Type":"ContainerStarted","Data":"79e220615b0049b1442f068fcefcdb97c336e262f7501c94e3a210afce09c2bc"}
Jul 08 16:34:08.628844 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:08.628804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:08.629041 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:08.628905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:08.629091 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:08.629064    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:08.629156 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:08.629127    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs podName:e1dfe72b-45e2-4611-afd4-f5a04fe89fbc nodeName:}" failed. No retries permitted until 2026-07-08 16:34:12.629107296 +0000 UTC m=+10.173460431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs") pod "network-metrics-daemon-bmrdj" (UID: "e1dfe72b-45e2-4611-afd4-f5a04fe89fbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:08.629586 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:08.629563    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:08.629705 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:08.629626    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret podName:a7b09743-c5b0-4b1e-82e3-37c9e8e09146 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:12.62960965 +0000 UTC m=+10.173962782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret") pod "global-pull-secret-syncer-mt9kk" (UID: "a7b09743-c5b0-4b1e-82e3-37c9e8e09146") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:08.730612 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:08.729946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:08.730612 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:08.730126    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:08.730612 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:08.730149    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:08.730612 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:08.730162    2583 projected.go:196] Error preparing data for projected volume kube-api-access-85jmw for pod openshift-network-diagnostics/network-check-target-6ltj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:08.730612 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:08.730220    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw podName:30ac66b0-607c-4ed9-bdb7-79065051bbb0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:12.7302003 +0000 UTC m=+10.274553435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-85jmw" (UniqueName: "kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw") pod "network-check-target-6ltj4" (UID: "30ac66b0-607c-4ed9-bdb7-79065051bbb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:09.002602 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:09.002475    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:09.003071 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:09.002632    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:09.003071 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:09.002704    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:09.003071 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:09.002793    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:10.000386 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:10.000352    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:10.000578 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:10.000503    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:11.000597 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:11.000563    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:11.000597 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:11.000584    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:11.001072 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:11.000694    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:11.001072 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:11.001052    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:12.000929 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:12.000470    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:12.000929 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:12.000600    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:12.662685 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:12.662644    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:12.662876 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:12.662716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:12.662951 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:12.662900    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:12.663006 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:12.662961    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret podName:a7b09743-c5b0-4b1e-82e3-37c9e8e09146 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:20.662943131 +0000 UTC m=+18.207296264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret") pod "global-pull-secret-syncer-mt9kk" (UID: "a7b09743-c5b0-4b1e-82e3-37c9e8e09146") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:12.663355 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:12.663325    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:12.663436 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:12.663371    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs podName:e1dfe72b-45e2-4611-afd4-f5a04fe89fbc nodeName:}" failed. No retries permitted until 2026-07-08 16:34:20.663357273 +0000 UTC m=+18.207710404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs") pod "network-metrics-daemon-bmrdj" (UID: "e1dfe72b-45e2-4611-afd4-f5a04fe89fbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:12.763135 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:12.763097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:12.763309 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:12.763273    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:12.763309 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:12.763288    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:12.763309 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:12.763296    2583 projected.go:196] Error preparing data for projected volume kube-api-access-85jmw for pod openshift-network-diagnostics/network-check-target-6ltj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:12.763481 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:12.763346    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw podName:30ac66b0-607c-4ed9-bdb7-79065051bbb0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:20.76332939 +0000 UTC m=+18.307682518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-85jmw" (UniqueName: "kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw") pod "network-check-target-6ltj4" (UID: "30ac66b0-607c-4ed9-bdb7-79065051bbb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:13.001362 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:13.001266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:13.001797 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:13.001374    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:13.001797 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:13.001418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:13.001797 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:13.001473    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:14.000040 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:14.000006    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:14.000192 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:14.000139    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:15.000351 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:14.999791    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:15.000351 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:14.999933    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:15.000351 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:14.999791    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:15.000351 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:15.000011    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:16.000348 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:16.000312    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:16.000579 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:16.000449    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:17.000716 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.000252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:17.000716 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:17.000559    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:17.000716 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.000628    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:17.000716 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:17.000685    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:17.126789 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.126706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wcwmf" event={"ID":"bd3aa765-2529-4fd1-824a-6324b48f7528","Type":"ContainerStarted","Data":"0beffe8c1bf66e206ca2a4ac072547aeae86ab0cedb9da3ee3cdef2c6044630f"}
Jul 08 16:34:17.128159 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.128135    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh" event={"ID":"d21075da-88bf-4f11-9b38-383dfd9c16e2","Type":"ContainerStarted","Data":"eb360cdbde145148a02edf77a48a9f0a6cbb042570b17798eb568be2a05134bb"}
Jul 08 16:34:17.129395 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.129372    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2tlm" event={"ID":"3ba94bac-d099-4adc-9ba5-fcaf01ee5f74","Type":"ContainerStarted","Data":"ff72dd2b39395bdd0a00b6ea72b1aee765d477567e06f589ca4f83b241083798"}
Jul 08 16:34:17.130679 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.130657    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qwhr9" event={"ID":"872e618a-29c3-405e-8e90-5bff364e11a4","Type":"ContainerStarted","Data":"6c00f3f749b05922fffd04393103c1b60b514dc4b1211ccef2885e47a59ee98c"}
Jul 08 16:34:17.131887 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.131857    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pkbl5" event={"ID":"85e37108-b3e5-43a9-803f-a409ced780e4","Type":"ContainerStarted","Data":"98f1eca0ec3dccf7f1a3955f2d7ac7b988d51cd9c387c824e8cd3ad4a490fdcb"}
Jul 08 16:34:17.133107 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.133083    2583 generic.go:356] "Generic (PLEG): container finished" podID="56996789-2cf7-4141-9898-ecd9eef72b7e" containerID="926b6172491d8309110e81fa437eea1fb54fe00b3635284f9f63ef95cd0f882b" exitCode=0
Jul 08 16:34:17.133169 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.133119    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9n4x" event={"ID":"56996789-2cf7-4141-9898-ecd9eef72b7e","Type":"ContainerDied","Data":"926b6172491d8309110e81fa437eea1fb54fe00b3635284f9f63ef95cd0f882b"}
Jul 08 16:34:17.144282 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.144237    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wcwmf" podStartSLOduration=3.531733762 podStartE2EDuration="14.144226158s" totalImagesPullingTime="10.612492396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:17.143989296 +0000 UTC m=+14.688342456" watchObservedRunningTime="2026-07-08 16:34:17.144226158 +0000 UTC m=+14.688579307"
Jul 08 16:34:17.144596 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.144570    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" podStartSLOduration=13.14456401 podStartE2EDuration="13.14456401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:08.130910453 +0000 UTC m=+5.675263607" watchObservedRunningTime="2026-07-08 16:34:17.14456401 +0000 UTC m=+14.688917158"
Jul 08 16:34:17.158486 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.158428    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pkbl5" podStartSLOduration=2.7165754250000003 podStartE2EDuration="14.158413625s" totalImagesPullingTime="11.4418382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:17.158356825 +0000 UTC m=+14.702709974" watchObservedRunningTime="2026-07-08 16:34:17.158413625 +0000 UTC m=+14.702766774"
Jul 08 16:34:17.179252 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.179212    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qwhr9" podStartSLOduration=3.785300163 podStartE2EDuration="14.179199128s" totalImagesPullingTime="10.393898965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:17.178723202 +0000 UTC m=+14.723076350" watchObservedRunningTime="2026-07-08 16:34:17.179199128 +0000 UTC m=+14.723552295"
Jul 08 16:34:17.194355 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.194305    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b2tlm" podStartSLOduration=3.790097105 podStartE2EDuration="14.194285562s" totalImagesPullingTime="10.404188457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:17.193717686 +0000 UTC m=+14.738070835" watchObservedRunningTime="2026-07-08 16:34:17.194285562 +0000 UTC m=+14.738638715"
Jul 08 16:34:17.360216 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.360178    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:17.360811 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.360791    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:17.786737 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.786697    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:17.787199 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:17.787179    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qwhr9"
Jul 08 16:34:18.000733 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:18.000250    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:18.000733 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:18.000351    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:19.000524 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:19.000491    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:19.000702 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:19.000494    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:19.000702 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:19.000639    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:19.001081 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:19.000755    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:19.139212 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:19.139170    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjh28" event={"ID":"cd7393d7-c4dd-40de-b68e-f8e154affeb7","Type":"ContainerStarted","Data":"fd70246dd66be018d3c678a3eaecf9234dbfbc6bddf5536394c51f244e6b4f0f"}
Jul 08 16:34:19.999730 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:19.999695    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:19.999928 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:19.999831    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:20.723509 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:20.723471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:20.724133 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:20.723547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:20.724133 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:20.723647    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:20.724133 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:20.723652    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:20.724133 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:20.723729    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs podName:e1dfe72b-45e2-4611-afd4-f5a04fe89fbc nodeName:}" failed. No retries permitted until 2026-07-08 16:34:36.723709615 +0000 UTC m=+34.268062742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs") pod "network-metrics-daemon-bmrdj" (UID: "e1dfe72b-45e2-4611-afd4-f5a04fe89fbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:20.724133 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:20.723761    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret podName:a7b09743-c5b0-4b1e-82e3-37c9e8e09146 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:36.723739538 +0000 UTC m=+34.268092682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret") pod "global-pull-secret-syncer-mt9kk" (UID: "a7b09743-c5b0-4b1e-82e3-37c9e8e09146") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:20.824576 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:20.824542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:20.824725 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:20.824691    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:20.824725 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:20.824708    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:20.824725 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:20.824717    2583 projected.go:196] Error preparing data for projected volume kube-api-access-85jmw for pod openshift-network-diagnostics/network-check-target-6ltj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:20.825480 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:20.825125    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw podName:30ac66b0-607c-4ed9-bdb7-79065051bbb0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:36.824755523 +0000 UTC m=+34.369108653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-85jmw" (UniqueName: "kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw") pod "network-check-target-6ltj4" (UID: "30ac66b0-607c-4ed9-bdb7-79065051bbb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:21.003231 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:21.003157    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:21.003411 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:21.003272    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:21.003411 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:21.003329    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:21.003537 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:21.003419    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:21.999915 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:21.999879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:22.000497 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:22.000011    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:23.003981 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:23.003940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:23.004429 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:23.004075    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:23.004429 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:23.004137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:23.004429 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:23.004203    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:23.999911 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:23.999880    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:24.000090 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:24.000028    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:25.000090 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:25.000057    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:25.000522 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:25.000063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:25.000522 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:25.000183    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:25.000522 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:25.000282    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:26.000885 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.000583    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:26.001238 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:26.000982    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:26.155409 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.155375    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:34:26.155827 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.155796    2583 generic.go:356] "Generic (PLEG): container finished" podID="a6a36d7e-2412-4a90-9cf8-4713b45ac268" containerID="6a1fdb47140d63ac5724f7aea756fad4230efe9c5b62350ab5138698b0f79c02" exitCode=1
Jul 08 16:34:26.155962 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.155867    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerStarted","Data":"a0a9d5aa8b90445b62b64bc35279ac05f45b7c82b3b69ab3c79bd38974cbf9d3"}
Jul 08 16:34:26.155962 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.155950    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerStarted","Data":"f6300dc37e6ae42914edbd88a7b4101d7d2758f7639fd1d34fcd3c0a7ace385b"}
Jul 08 16:34:26.156087 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.156002    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerStarted","Data":"9d04c834f9b518c70309573c2c7d14c8df6573211b2a2dbf2f39fd3b4db5c8c3"}
Jul 08 16:34:26.156087 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.156051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerDied","Data":"6a1fdb47140d63ac5724f7aea756fad4230efe9c5b62350ab5138698b0f79c02"}
Jul 08 16:34:26.156182 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.156097    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerStarted","Data":"dc661e32b19ff4a215b0c6ce40a437a7e55c674a5b6dcd5acff1ab811292f1fe"}
Jul 08 16:34:26.157584 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.157561    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8m7pv" event={"ID":"2165d4c2-a77d-4b76-b474-95315fb06fd7","Type":"ContainerStarted","Data":"a67658738741ac8bd1d9e0ea2108acb10c18ecec585afba7d5454328ce50d483"}
Jul 08 16:34:26.180735 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.180681    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wjh28" podStartSLOduration=12.797623956 podStartE2EDuration="23.180660961s" totalImagesPullingTime="10.383037005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:19.158865101 +0000 UTC m=+16.703218250" watchObservedRunningTime="2026-07-08 16:34:26.180660961 +0000 UTC m=+23.725014111"
Jul 08 16:34:26.181030 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.180996    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8m7pv" podStartSLOduration=3.923807433 podStartE2EDuration="23.18098946s" totalImagesPullingTime="19.257182027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:26.180752186 +0000 UTC m=+23.725105335" watchObservedRunningTime="2026-07-08 16:34:26.18098946 +0000 UTC m=+23.725342609"
Jul 08 16:34:26.610661 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.610642    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 16:34:26.949944 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.949817    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T16:34:26.610657449Z","UUID":"40acea58-8209-4e14-8ac4-36e917aa33b5","Handler":null,"Name":"","Endpoint":""}
Jul 08 16:34:26.951138 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.951121    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 16:34:26.951232 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:26.951154    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 16:34:27.003406 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:27.003372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:27.004077 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:27.003501    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:27.004077 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:27.003670    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:27.004077 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:27.003786    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:27.162279 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:27.162243    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh" event={"ID":"d21075da-88bf-4f11-9b38-383dfd9c16e2","Type":"ContainerStarted","Data":"964cf6c90e5ebfaef8b25d639a07566ab25bf6ec07561bf7e71e783c462eaf30"}
Jul 08 16:34:27.165298 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:27.165274    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:34:27.165733 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:27.165714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerStarted","Data":"7bee22f4c15d79037b12d0870daf9f193c23ab11966c496f173572c395185eba"}
Jul 08 16:34:28.000020 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:27.999980    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:28.000203 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:28.000111    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:29.002472 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:29.002440    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:29.002819 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:29.002563    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:29.002819 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:29.002616    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:29.002819 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:29.002692    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:30.000159 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:30.000089    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:30.000331 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:30.000174    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:30.173433 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:30.173399    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh" event={"ID":"d21075da-88bf-4f11-9b38-383dfd9c16e2","Type":"ContainerStarted","Data":"b534e582cce2a7c8f68d46432f1a412662143d98a57dc7a71c7cf64dd51f441c"}
Jul 08 16:34:30.175050 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:30.175022    2583 generic.go:356] "Generic (PLEG): container finished" podID="56996789-2cf7-4141-9898-ecd9eef72b7e" containerID="2332a7802b36551695f4e6a2f9ad0761c5d378f52f9eacfa5aa4ede07f26c690" exitCode=0
Jul 08 16:34:30.175166 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:30.175093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9n4x" event={"ID":"56996789-2cf7-4141-9898-ecd9eef72b7e","Type":"ContainerDied","Data":"2332a7802b36551695f4e6a2f9ad0761c5d378f52f9eacfa5aa4ede07f26c690"}
Jul 08 16:34:30.178388 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:30.178307    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:34:30.178680 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:30.178663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerStarted","Data":"43f786984f93b54125a58fdf1c5769481db17ea41df8b02ec20f9f7bca238945"}
Jul 08 16:34:30.194965 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:30.194924    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-srkjh" podStartSLOduration=4.620241338 podStartE2EDuration="27.194912081s" totalImagesPullingTime="22.574670743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:30.194626728 +0000 UTC m=+27.738979877" watchObservedRunningTime="2026-07-08 16:34:30.194912081 +0000 UTC m=+27.739265230"
Jul 08 16:34:30.999983 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:30.999952    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:31.000217 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:31.000155    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:31.000217 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:31.000196    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:31.000303 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:31.000277    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:31.999870 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:31.999632    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:32.000403 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:31.999878    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:32.185794 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:32.185764    2583 generic.go:356] "Generic (PLEG): container finished" podID="56996789-2cf7-4141-9898-ecd9eef72b7e" containerID="2d29ac9baf6738c25c3e89dda7508fe52795e972ba7e25da851fc5563f6583e0" exitCode=0
Jul 08 16:34:32.185942 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:32.185846    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9n4x" event={"ID":"56996789-2cf7-4141-9898-ecd9eef72b7e","Type":"ContainerDied","Data":"2d29ac9baf6738c25c3e89dda7508fe52795e972ba7e25da851fc5563f6583e0"}
Jul 08 16:34:32.189257 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:32.189241    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:34:32.189563 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:32.189546    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerStarted","Data":"7b219db0a0f85839b61b43bdb766807e4953fa7b1f425cae0c8f922a381b27c6"}
Jul 08 16:34:32.189815 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:32.189798    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:32.189919 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:32.189855    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:32.190040 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:32.190024    2583 scope.go:117] "RemoveContainer" containerID="6a1fdb47140d63ac5724f7aea756fad4230efe9c5b62350ab5138698b0f79c02"
Jul 08 16:34:32.205842 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:32.205825    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:33.001252 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.001221    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:33.001698 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:33.001310    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:33.001698 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.001368    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:33.001698 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:33.001516    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:33.194864 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.194834    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:34:33.195146 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.195123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" event={"ID":"a6a36d7e-2412-4a90-9cf8-4713b45ac268","Type":"ContainerStarted","Data":"edb925d28a20894110b6c4ee3ca06c69067990f65516ab6dab14c2e8aff33097"}
Jul 08 16:34:33.195385 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.195365    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:33.210510 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.210489    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:34:33.223771 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.223731    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r" podStartSLOduration=10.953378004 podStartE2EDuration="30.223718455s" totalImagesPullingTime="19.270340451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:33.221873368 +0000 UTC m=+30.766226517" watchObservedRunningTime="2026-07-08 16:34:33.223718455 +0000 UTC m=+30.768071603"
Jul 08 16:34:33.981470 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.981423    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6ltj4"]
Jul 08 16:34:33.981620 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.981595    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:33.981720 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:33.981696    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:33.984284 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.984258    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bmrdj"]
Jul 08 16:34:33.984441 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.984376    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:33.984523 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:33.984494    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:33.993179 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.993152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mt9kk"]
Jul 08 16:34:33.993304 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:33.993246    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:33.993360 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:33.993340    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:34.199652 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:34.199564    2583 generic.go:356] "Generic (PLEG): container finished" podID="56996789-2cf7-4141-9898-ecd9eef72b7e" containerID="46415ba18133797ad6684ff2a128ca33dde6ae8357108c90a1334b053fd548f5" exitCode=0
Jul 08 16:34:34.200055 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:34.199650    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9n4x" event={"ID":"56996789-2cf7-4141-9898-ecd9eef72b7e","Type":"ContainerDied","Data":"46415ba18133797ad6684ff2a128ca33dde6ae8357108c90a1334b053fd548f5"}
Jul 08 16:34:36.000678 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:36.000466    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:36.001228 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:36.000504    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:36.001228 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.000767    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mt9kk" podUID="a7b09743-c5b0-4b1e-82e3-37c9e8e09146"
Jul 08 16:34:36.001228 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:36.000518    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:36.001228 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.000868    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ltj4" podUID="30ac66b0-607c-4ed9-bdb7-79065051bbb0"
Jul 08 16:34:36.001228 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.000964    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmrdj" podUID="e1dfe72b-45e2-4611-afd4-f5a04fe89fbc"
Jul 08 16:34:36.739572 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:36.739537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:36.739733 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:36.739582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:36.739733 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.739688    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:36.739733 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.739688    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:36.739835 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.739741    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret podName:a7b09743-c5b0-4b1e-82e3-37c9e8e09146 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:08.739727925 +0000 UTC m=+66.284081054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret") pod "global-pull-secret-syncer-mt9kk" (UID: "a7b09743-c5b0-4b1e-82e3-37c9e8e09146") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:36.739835 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.739754    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs podName:e1dfe72b-45e2-4611-afd4-f5a04fe89fbc nodeName:}" failed. No retries permitted until 2026-07-08 16:35:08.739748604 +0000 UTC m=+66.284101731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs") pod "network-metrics-daemon-bmrdj" (UID: "e1dfe72b-45e2-4611-afd4-f5a04fe89fbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:36.840408 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:36.840375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:36.840619 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.840537    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:36.840619 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.840552    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:36.840619 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.840561    2583 projected.go:196] Error preparing data for projected volume kube-api-access-85jmw for pod openshift-network-diagnostics/network-check-target-6ltj4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:36.840619 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:36.840619    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw podName:30ac66b0-607c-4ed9-bdb7-79065051bbb0 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:08.84060092 +0000 UTC m=+66.384954050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-85jmw" (UniqueName: "kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw") pod "network-check-target-6ltj4" (UID: "30ac66b0-607c-4ed9-bdb7-79065051bbb0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:37.187046 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.187021    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeReady"
Jul 08 16:34:37.187381 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.187158    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 16:34:37.225040 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.225006    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5445697769-jn6vc"]
Jul 08 16:34:37.228414 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.228388    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.231094 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.231068    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 16:34:37.231198 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.231126    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqktz\""
Jul 08 16:34:37.231198 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.231136    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 16:34:37.231353 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.231338    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 16:34:37.237815 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.237792    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 16:34:37.238259 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.238239    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pgpdv"]
Jul 08 16:34:37.242776 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.242746    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5445697769-jn6vc"]
Jul 08 16:34:37.242898 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.242854    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.243958 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.243904    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kxnpg"]
Jul 08 16:34:37.245380 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.245362    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 16:34:37.245496 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.245368    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 16:34:37.245651 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.245636    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jflkn\""
Jul 08 16:34:37.247796 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.247778    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kxnpg"
Jul 08 16:34:37.250960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.250912    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lgg5h\""
Jul 08 16:34:37.251130 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.251116    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 16:34:37.251872 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.251289    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 16:34:37.251872 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.251335    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgpdv"]
Jul 08 16:34:37.251872 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.251523    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 16:34:37.258051 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.257992    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kxnpg"]
Jul 08 16:34:37.345104 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpfgt\" (UniqueName: \"kubernetes.io/projected/0d90ba13-50da-4fc8-a242-3d2b776fb911-kube-api-access-zpfgt\") pod \"ingress-canary-kxnpg\" (UID: \"0d90ba13-50da-4fc8-a242-3d2b776fb911\") " pod="openshift-ingress-canary/ingress-canary-kxnpg"
Jul 08 16:34:37.345296 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345123    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/14fac487-6238-415a-a098-0fa02b5375dd-ca-trust-extracted\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.345296 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-installation-pull-secrets\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.345296 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl9pq\" (UniqueName: \"kubernetes.io/projected/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-kube-api-access-nl9pq\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.345296 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345214    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-config-volume\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.345296 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.345513 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345304    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-image-registry-private-configuration\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.345513 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-tmp-dir\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.345513 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-registry-certificates\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.345513 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-trusted-ca\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.345513 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd48z\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-kube-api-access-fd48z\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.345513 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.345513 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345505    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d90ba13-50da-4fc8-a242-3d2b776fb911-cert\") pod \"ingress-canary-kxnpg\" (UID: \"0d90ba13-50da-4fc8-a242-3d2b776fb911\") " pod="openshift-ingress-canary/ingress-canary-kxnpg"
Jul 08 16:34:37.345728 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.345534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-bound-sa-token\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.446728 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.446647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpfgt\" (UniqueName: \"kubernetes.io/projected/0d90ba13-50da-4fc8-a242-3d2b776fb911-kube-api-access-zpfgt\") pod \"ingress-canary-kxnpg\" (UID: \"0d90ba13-50da-4fc8-a242-3d2b776fb911\") " pod="openshift-ingress-canary/ingress-canary-kxnpg"
Jul 08 16:34:37.446728 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.446714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/14fac487-6238-415a-a098-0fa02b5375dd-ca-trust-extracted\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.446951 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.446894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-installation-pull-secrets\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.446951 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.446935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl9pq\" (UniqueName: \"kubernetes.io/projected/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-kube-api-access-nl9pq\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.447055 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.446969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-config-volume\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.447055 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.447137 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-image-registry-private-configuration\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.447137 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-tmp-dir\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.447137 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447100    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/14fac487-6238-415a-a098-0fa02b5375dd-ca-trust-extracted\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.447137 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-registry-certificates\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.447258 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-trusted-ca\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.447258 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd48z\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-kube-api-access-fd48z\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.447258 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.447258 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d90ba13-50da-4fc8-a242-3d2b776fb911-cert\") pod \"ingress-canary-kxnpg\" (UID: \"0d90ba13-50da-4fc8-a242-3d2b776fb911\") " pod="openshift-ingress-canary/ingress-canary-kxnpg"
Jul 08 16:34:37.447371 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-bound-sa-token\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.448535 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.447508    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:34:37.448535 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.447572    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls podName:2b8a2df0-53f6-4d0f-89f5-5b5572ed9384 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:37.947554269 +0000 UTC m=+35.491907398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls") pod "dns-default-pgpdv" (UID: "2b8a2df0-53f6-4d0f-89f5-5b5572ed9384") : secret "dns-default-metrics-tls" not found
Jul 08 16:34:37.448535 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447585    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-registry-certificates\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.448535 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.447595    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 16:34:37.448535 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.447614    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5445697769-jn6vc: secret "image-registry-tls" not found
Jul 08 16:34:37.448535 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.447675    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls podName:14fac487-6238-415a-a098-0fa02b5375dd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:37.947656901 +0000 UTC m=+35.492010030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls") pod "image-registry-5445697769-jn6vc" (UID: "14fac487-6238-415a-a098-0fa02b5375dd") : secret "image-registry-tls" not found
Jul 08 16:34:37.448535 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447816    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-tmp-dir\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.448535 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.447945    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-config-volume\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.448535 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.448497    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-trusted-ca\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.452200 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.452181    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d90ba13-50da-4fc8-a242-3d2b776fb911-cert\") pod \"ingress-canary-kxnpg\" (UID: \"0d90ba13-50da-4fc8-a242-3d2b776fb911\") " pod="openshift-ingress-canary/ingress-canary-kxnpg"
Jul 08 16:34:37.452303 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.452198    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-installation-pull-secrets\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.452816 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.452796    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-image-registry-private-configuration\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.459612 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.459584    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl9pq\" (UniqueName: \"kubernetes.io/projected/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-kube-api-access-nl9pq\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.459731 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.459712    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-bound-sa-token\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.459786 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.459717    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpfgt\" (UniqueName: \"kubernetes.io/projected/0d90ba13-50da-4fc8-a242-3d2b776fb911-kube-api-access-zpfgt\") pod \"ingress-canary-kxnpg\" (UID: \"0d90ba13-50da-4fc8-a242-3d2b776fb911\") " pod="openshift-ingress-canary/ingress-canary-kxnpg"
Jul 08 16:34:37.460751 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.460732    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd48z\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-kube-api-access-fd48z\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.561711 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.561672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kxnpg"
Jul 08 16:34:37.711478 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.709823    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kxnpg"]
Jul 08 16:34:37.942370 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.942289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwhr9_872e618a-29c3-405e-8e90-5bff364e11a4/konnectivity-agent/0.log" limit=1024
Jul 08 16:34:37.952219 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.952186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:37.952352 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:37.952268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:37.952352 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.952332    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:34:37.952482 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.952382    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 16:34:37.952482 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.952397    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5445697769-jn6vc: secret "image-registry-tls" not found
Jul 08 16:34:37.952482 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.952404    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls podName:2b8a2df0-53f6-4d0f-89f5-5b5572ed9384 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:38.952383471 +0000 UTC m=+36.496736604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls") pod "dns-default-pgpdv" (UID: "2b8a2df0-53f6-4d0f-89f5-5b5572ed9384") : secret "dns-default-metrics-tls" not found
Jul 08 16:34:37.952482 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:37.952466    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls podName:14fac487-6238-415a-a098-0fa02b5375dd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:38.952436995 +0000 UTC m=+36.496790127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls") pod "image-registry-5445697769-jn6vc" (UID: "14fac487-6238-415a-a098-0fa02b5375dd") : secret "image-registry-tls" not found
Jul 08 16:34:38.000119 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.000040    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:34:38.000119 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.000057    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:34:38.000303 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.000221    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:34:38.004142 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.004109    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 16:34:38.004142 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.004135    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 16:34:38.004338 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.004157    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7mv4\""
Jul 08 16:34:38.004338 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.004110    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 16:34:38.004338 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.004198    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-krkqn\""
Jul 08 16:34:38.004338 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.004213    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 16:34:38.048745 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.048719    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwhr9_872e618a-29c3-405e-8e90-5bff364e11a4/konnectivity-agent/0.log" limit=1024
Jul 08 16:34:38.150361 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.150315    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwhr9_872e618a-29c3-405e-8e90-5bff364e11a4/konnectivity-agent/0.log" limit=1024
Jul 08 16:34:38.210140 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.210109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kxnpg" event={"ID":"0d90ba13-50da-4fc8-a242-3d2b776fb911","Type":"ContainerStarted","Data":"e205cab17dece3420bc6a07c10f96e23c8ecaa9bad3aed5e2b9ef36c9971a8b6"}
Jul 08 16:34:38.961494 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.961221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:38.961695 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:38.961558    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:38.961754 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:38.961714    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 16:34:38.961754 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:38.961728    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5445697769-jn6vc: secret "image-registry-tls" not found
Jul 08 16:34:38.961854 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:38.961795    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls podName:14fac487-6238-415a-a098-0fa02b5375dd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:40.961777748 +0000 UTC m=+38.506130897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls") pod "image-registry-5445697769-jn6vc" (UID: "14fac487-6238-415a-a098-0fa02b5375dd") : secret "image-registry-tls" not found
Jul 08 16:34:38.962242 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:38.962222    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:34:38.962332 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:38.962280    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls podName:2b8a2df0-53f6-4d0f-89f5-5b5572ed9384 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:40.962265352 +0000 UTC m=+38.506618496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls") pod "dns-default-pgpdv" (UID: "2b8a2df0-53f6-4d0f-89f5-5b5572ed9384") : secret "dns-default-metrics-tls" not found
Jul 08 16:34:39.567536 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:39.567504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwhr9_872e618a-29c3-405e-8e90-5bff364e11a4/konnectivity-agent/0.log" limit=1024
Jul 08 16:34:39.669363 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:39.669322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwhr9_872e618a-29c3-405e-8e90-5bff364e11a4/konnectivity-agent/0.log" limit=1024
Jul 08 16:34:40.978577 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:40.978532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:40.979015 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:40.978646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:40.979015 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:40.978720    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 16:34:40.979015 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:40.978742    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5445697769-jn6vc: secret "image-registry-tls" not found
Jul 08 16:34:40.979015 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:40.978765    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:34:40.979015 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:40.978816    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls podName:14fac487-6238-415a-a098-0fa02b5375dd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:44.978797109 +0000 UTC m=+42.523150251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls") pod "image-registry-5445697769-jn6vc" (UID: "14fac487-6238-415a-a098-0fa02b5375dd") : secret "image-registry-tls" not found
Jul 08 16:34:40.979015 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:40.978836    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls podName:2b8a2df0-53f6-4d0f-89f5-5b5572ed9384 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:44.978826446 +0000 UTC m=+42.523179578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls") pod "dns-default-pgpdv" (UID: "2b8a2df0-53f6-4d0f-89f5-5b5572ed9384") : secret "dns-default-metrics-tls" not found
Jul 08 16:34:42.218913 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:42.218882    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kxnpg" event={"ID":"0d90ba13-50da-4fc8-a242-3d2b776fb911","Type":"ContainerStarted","Data":"c0ea65c2325775b78e3c1faf37cbdcbcde862888e76aebfe83c77d65fc6bf8dc"}
Jul 08 16:34:42.221520 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:42.221495    2583 generic.go:356] "Generic (PLEG): container finished" podID="56996789-2cf7-4141-9898-ecd9eef72b7e" containerID="a18da71bc32e7cc18e076852f172fdef7d7cf9911ca29a689e5b71b8b8be318c" exitCode=0
Jul 08 16:34:42.221653 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:42.221548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9n4x" event={"ID":"56996789-2cf7-4141-9898-ecd9eef72b7e","Type":"ContainerDied","Data":"a18da71bc32e7cc18e076852f172fdef7d7cf9911ca29a689e5b71b8b8be318c"}
Jul 08 16:34:42.238471 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:42.236958    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kxnpg" podStartSLOduration=1.487220258 podStartE2EDuration="5.236939597s" totalImagesPullingTime="3.749719339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:42.235932315 +0000 UTC m=+39.780285467" watchObservedRunningTime="2026-07-08 16:34:42.236939597 +0000 UTC m=+39.781292749"
Jul 08 16:34:43.226982 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:43.226953    2583 generic.go:356] "Generic (PLEG): container finished" podID="56996789-2cf7-4141-9898-ecd9eef72b7e" containerID="76891b3fcdb385c052694ce84a9ca28974c758395d8af6b71228e778810f87c9" exitCode=0
Jul 08 16:34:43.227346 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:43.227034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9n4x" event={"ID":"56996789-2cf7-4141-9898-ecd9eef72b7e","Type":"ContainerDied","Data":"76891b3fcdb385c052694ce84a9ca28974c758395d8af6b71228e778810f87c9"}
Jul 08 16:34:44.232672 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:44.232481    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9n4x" event={"ID":"56996789-2cf7-4141-9898-ecd9eef72b7e","Type":"ContainerStarted","Data":"9ba4baffb3f59bcc0af9de8e032a6b2ec5752c2966bd9db647190c4abe2a0f8d"}
Jul 08 16:34:44.256722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:44.256673    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z9n4x" podStartSLOduration=9.229028844 podStartE2EDuration="41.256658506s" totalImagesPullingTime="32.027629662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:44.255541666 +0000 UTC m=+41.799894814" watchObservedRunningTime="2026-07-08 16:34:44.256658506 +0000 UTC m=+41.801011656"
Jul 08 16:34:45.010406 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:45.010375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:45.010593 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:45.010431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:45.010593 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:45.010533    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:34:45.010593 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:45.010539    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 16:34:45.010593 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:45.010553    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5445697769-jn6vc: secret "image-registry-tls" not found
Jul 08 16:34:45.010593 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:45.010579    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls podName:2b8a2df0-53f6-4d0f-89f5-5b5572ed9384 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:53.010566638 +0000 UTC m=+50.554919765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls") pod "dns-default-pgpdv" (UID: "2b8a2df0-53f6-4d0f-89f5-5b5572ed9384") : secret "dns-default-metrics-tls" not found
Jul 08 16:34:45.010779 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:45.010601    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls podName:14fac487-6238-415a-a098-0fa02b5375dd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:53.010588216 +0000 UTC m=+50.554941343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls") pod "image-registry-5445697769-jn6vc" (UID: "14fac487-6238-415a-a098-0fa02b5375dd") : secret "image-registry-tls" not found
Jul 08 16:34:53.066285 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:53.066241    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:34:53.066911 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:53.066317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:34:53.066911 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:53.066397    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 16:34:53.066911 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:53.066416    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5445697769-jn6vc: secret "image-registry-tls" not found
Jul 08 16:34:53.066911 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:53.066403    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:34:53.066911 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:53.066478    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls podName:14fac487-6238-415a-a098-0fa02b5375dd nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.066463358 +0000 UTC m=+66.610816498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls") pod "image-registry-5445697769-jn6vc" (UID: "14fac487-6238-415a-a098-0fa02b5375dd") : secret "image-registry-tls" not found
Jul 08 16:34:53.066911 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:34:53.066535    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls podName:2b8a2df0-53f6-4d0f-89f5-5b5572ed9384 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.066522894 +0000 UTC m=+66.610876021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls") pod "dns-default-pgpdv" (UID: "2b8a2df0-53f6-4d0f-89f5-5b5572ed9384") : secret "dns-default-metrics-tls" not found
Jul 08 16:34:56.796058 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.796029    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xvsqs"]
Jul 08 16:34:56.798958 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.798940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.801533 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.801509    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"]
Jul 08 16:34:56.801955 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.801933    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:34:56.802061 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.801959    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ks7ln\""
Jul 08 16:34:56.802061 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.801987    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 08 16:34:56.802061 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.802019    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 08 16:34:56.802203 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.802066    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 08 16:34:56.803315 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.803300    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:56.808963 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.808941    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 08 16:34:56.811162 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.810900    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 08 16:34:56.811267 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.811174    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 08 16:34:56.811267 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.811184    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6dplz\""
Jul 08 16:34:56.811377 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.811297    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:34:56.812663 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.812643    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xvsqs"]
Jul 08 16:34:56.813794 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.813776    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 08 16:34:56.815311 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.815288    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"]
Jul 08 16:34:56.894695 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.894658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-config\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.894871 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.894713    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-serving-cert\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.894871 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.894730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-trusted-ca\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.894871 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.894780    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v62z\" (UniqueName: \"kubernetes.io/projected/e145071b-da47-4529-8166-af9fce467d01-kube-api-access-7v62z\") pod \"kube-storage-version-migrator-operator-846bf668f7-psq6v\" (UID: \"e145071b-da47-4529-8166-af9fce467d01\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:56.894871 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.894817    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcgzj\" (UniqueName: \"kubernetes.io/projected/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-kube-api-access-hcgzj\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.894871 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.894851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e145071b-da47-4529-8166-af9fce467d01-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-psq6v\" (UID: \"e145071b-da47-4529-8166-af9fce467d01\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:56.895032 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.894883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e145071b-da47-4529-8166-af9fce467d01-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-psq6v\" (UID: \"e145071b-da47-4529-8166-af9fce467d01\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:56.920183 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.920153    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g"]
Jul 08 16:34:56.922060 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.922040    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g"
Jul 08 16:34:56.924559 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.924535    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lrqbg\""
Jul 08 16:34:56.924688 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.924573    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:34:56.924688 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.924639    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 08 16:34:56.932606 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.932584    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g"]
Jul 08 16:34:56.995899 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.995864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v62z\" (UniqueName: \"kubernetes.io/projected/e145071b-da47-4529-8166-af9fce467d01-kube-api-access-7v62z\") pod \"kube-storage-version-migrator-operator-846bf668f7-psq6v\" (UID: \"e145071b-da47-4529-8166-af9fce467d01\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:56.996075 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.995908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcgzj\" (UniqueName: \"kubernetes.io/projected/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-kube-api-access-hcgzj\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.996075 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.996038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e145071b-da47-4529-8166-af9fce467d01-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-psq6v\" (UID: \"e145071b-da47-4529-8166-af9fce467d01\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:56.996152 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.996083    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e145071b-da47-4529-8166-af9fce467d01-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-psq6v\" (UID: \"e145071b-da47-4529-8166-af9fce467d01\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:56.996152 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.996139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-config\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.996251 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.996189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-serving-cert\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.996251 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.996205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-trusted-ca\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.996677 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.996656    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e145071b-da47-4529-8166-af9fce467d01-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-psq6v\" (UID: \"e145071b-da47-4529-8166-af9fce467d01\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:56.996807 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.996787    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-config\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:56.997423 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:56.997400    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-trusted-ca\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:57.000342 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.000317    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-serving-cert\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:57.000342 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.000325    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e145071b-da47-4529-8166-af9fce467d01-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-psq6v\" (UID: \"e145071b-da47-4529-8166-af9fce467d01\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:57.008289 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.008266    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcgzj\" (UniqueName: \"kubernetes.io/projected/e15f68d5-4636-447e-b69f-b8a2c9a84c8f-kube-api-access-hcgzj\") pod \"console-operator-68b757fb67-xvsqs\" (UID: \"e15f68d5-4636-447e-b69f-b8a2c9a84c8f\") " pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:57.008624 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.008609    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v62z\" (UniqueName: \"kubernetes.io/projected/e145071b-da47-4529-8166-af9fce467d01-kube-api-access-7v62z\") pod \"kube-storage-version-migrator-operator-846bf668f7-psq6v\" (UID: \"e145071b-da47-4529-8166-af9fce467d01\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:57.096771 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.096681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrz9s\" (UniqueName: \"kubernetes.io/projected/3a6f4b42-512a-424d-9aca-b2717225a405-kube-api-access-xrz9s\") pod \"volume-data-source-validator-5d456fdbcd-tkc4g\" (UID: \"3a6f4b42-512a-424d-9aca-b2717225a405\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g"
Jul 08 16:34:57.113580 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.113555    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:34:57.118898 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.118874    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"
Jul 08 16:34:57.198220 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.197801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrz9s\" (UniqueName: \"kubernetes.io/projected/3a6f4b42-512a-424d-9aca-b2717225a405-kube-api-access-xrz9s\") pod \"volume-data-source-validator-5d456fdbcd-tkc4g\" (UID: \"3a6f4b42-512a-424d-9aca-b2717225a405\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g"
Jul 08 16:34:57.212507 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.212440    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrz9s\" (UniqueName: \"kubernetes.io/projected/3a6f4b42-512a-424d-9aca-b2717225a405-kube-api-access-xrz9s\") pod \"volume-data-source-validator-5d456fdbcd-tkc4g\" (UID: \"3a6f4b42-512a-424d-9aca-b2717225a405\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g"
Jul 08 16:34:57.230788 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.230733    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g"
Jul 08 16:34:57.272769 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.272738    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v"]
Jul 08 16:34:57.275846 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:57.275818    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode145071b_da47_4529_8166_af9fce467d01.slice/crio-11a7677648c72776a375f1f18cb903d2b0ec57e6cd4a094716d083f7a4d11c13 WatchSource:0}: Error finding container 11a7677648c72776a375f1f18cb903d2b0ec57e6cd4a094716d083f7a4d11c13: Status 404 returned error can't find the container with id 11a7677648c72776a375f1f18cb903d2b0ec57e6cd4a094716d083f7a4d11c13
Jul 08 16:34:57.285785 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.285632    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xvsqs"]
Jul 08 16:34:57.291259 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:57.291216    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15f68d5_4636_447e_b69f_b8a2c9a84c8f.slice/crio-9b411ca890abc7b5f668aba18f125af168bb1ea80c308cfdfa7fb51c23234b32 WatchSource:0}: Error finding container 9b411ca890abc7b5f668aba18f125af168bb1ea80c308cfdfa7fb51c23234b32: Status 404 returned error can't find the container with id 9b411ca890abc7b5f668aba18f125af168bb1ea80c308cfdfa7fb51c23234b32
Jul 08 16:34:57.366784 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:57.366629    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g"]
Jul 08 16:34:57.369034 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:57.369010    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6f4b42_512a_424d_9aca_b2717225a405.slice/crio-8fd6757115579201dabf6b5ab249ad8d70bd232629af7040cd9502e22b660737 WatchSource:0}: Error finding container 8fd6757115579201dabf6b5ab249ad8d70bd232629af7040cd9502e22b660737: Status 404 returned error can't find the container with id 8fd6757115579201dabf6b5ab249ad8d70bd232629af7040cd9502e22b660737
Jul 08 16:34:58.267415 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.267381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v" event={"ID":"e145071b-da47-4529-8166-af9fce467d01","Type":"ContainerStarted","Data":"11a7677648c72776a375f1f18cb903d2b0ec57e6cd4a094716d083f7a4d11c13"}
Jul 08 16:34:58.268795 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.268764    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g" event={"ID":"3a6f4b42-512a-424d-9aca-b2717225a405","Type":"ContainerStarted","Data":"8fd6757115579201dabf6b5ab249ad8d70bd232629af7040cd9502e22b660737"}
Jul 08 16:34:58.270028 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.270005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" event={"ID":"e15f68d5-4636-447e-b69f-b8a2c9a84c8f","Type":"ContainerStarted","Data":"9b411ca890abc7b5f668aba18f125af168bb1ea80c308cfdfa7fb51c23234b32"}
Jul 08 16:34:58.324267 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.324231    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7"]
Jul 08 16:34:58.326439 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.326418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7"
Jul 08 16:34:58.330330 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.329870    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f8hpd\""
Jul 08 16:34:58.339525 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.339437    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7"]
Jul 08 16:34:58.509491 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.509375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk97v\" (UniqueName: \"kubernetes.io/projected/d46e2dd2-8dd6-43bb-b8ed-5f163e5c8af8-kube-api-access-mk97v\") pod \"network-check-source-989f8b8dc-zh6r7\" (UID: \"d46e2dd2-8dd6-43bb-b8ed-5f163e5c8af8\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7"
Jul 08 16:34:58.609760 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.609721    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk97v\" (UniqueName: \"kubernetes.io/projected/d46e2dd2-8dd6-43bb-b8ed-5f163e5c8af8-kube-api-access-mk97v\") pod \"network-check-source-989f8b8dc-zh6r7\" (UID: \"d46e2dd2-8dd6-43bb-b8ed-5f163e5c8af8\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7"
Jul 08 16:34:58.619270 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.619239    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk97v\" (UniqueName: \"kubernetes.io/projected/d46e2dd2-8dd6-43bb-b8ed-5f163e5c8af8-kube-api-access-mk97v\") pod \"network-check-source-989f8b8dc-zh6r7\" (UID: \"d46e2dd2-8dd6-43bb-b8ed-5f163e5c8af8\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7"
Jul 08 16:34:58.639804 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.639781    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7"
Jul 08 16:34:58.771810 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:58.771786    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7"]
Jul 08 16:34:58.775049 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:34:58.775022    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46e2dd2_8dd6_43bb_b8ed_5f163e5c8af8.slice/crio-7e61b365d297b4d44c5ee67c404e6dba0451d75dcb62b9fb695f2f54979eb4cc WatchSource:0}: Error finding container 7e61b365d297b4d44c5ee67c404e6dba0451d75dcb62b9fb695f2f54979eb4cc: Status 404 returned error can't find the container with id 7e61b365d297b4d44c5ee67c404e6dba0451d75dcb62b9fb695f2f54979eb4cc
Jul 08 16:34:59.275085 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:59.275037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g" event={"ID":"3a6f4b42-512a-424d-9aca-b2717225a405","Type":"ContainerStarted","Data":"6b9e8bc294a124227a74585801a8b4667e944b391fb3e7a86adfe9b6dc83930e"}
Jul 08 16:34:59.276483 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:59.276436    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7" event={"ID":"d46e2dd2-8dd6-43bb-b8ed-5f163e5c8af8","Type":"ContainerStarted","Data":"7e61b365d297b4d44c5ee67c404e6dba0451d75dcb62b9fb695f2f54979eb4cc"}
Jul 08 16:34:59.291813 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:34:59.291762    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tkc4g" podStartSLOduration=2.095605573 podStartE2EDuration="3.291746695s" totalImagesPullingTime="1.196141122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:59.290805666 +0000 UTC m=+56.835158815" watchObservedRunningTime="2026-07-08 16:34:59.291746695 +0000 UTC m=+56.836099856"
Jul 08 16:35:00.283110 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:00.282599    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v" event={"ID":"e145071b-da47-4529-8166-af9fce467d01","Type":"ContainerStarted","Data":"3bdb2d4b0a15af9819f3ae62b633f7c6ce48809aa5e9d3f010988faeff66e9ee"}
Jul 08 16:35:00.285493 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:00.285123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" event={"ID":"e15f68d5-4636-447e-b69f-b8a2c9a84c8f","Type":"ContainerStarted","Data":"eff638059b8abdd03a21b811a7246230566d97849386c3e3a756e18a04b48e51"}
Jul 08 16:35:00.301181 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:00.300605    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v" podStartSLOduration=1.394470979 podStartE2EDuration="4.300575557s" totalImagesPullingTime="2.906104578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:00.299488745 +0000 UTC m=+57.843841896" watchObservedRunningTime="2026-07-08 16:35:00.300575557 +0000 UTC m=+57.844928707"
Jul 08 16:35:00.316556 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:00.316357    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" podStartSLOduration=1.429904055 podStartE2EDuration="4.316334769s" totalImagesPullingTime="2.886430714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:00.315314246 +0000 UTC m=+57.859667396" watchObservedRunningTime="2026-07-08 16:35:00.316334769 +0000 UTC m=+57.860687920"
Jul 08 16:35:01.289595 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:01.289564    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/0.log"
Jul 08 16:35:01.290048 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:01.289610    2583 generic.go:356] "Generic (PLEG): container finished" podID="e15f68d5-4636-447e-b69f-b8a2c9a84c8f" containerID="eff638059b8abdd03a21b811a7246230566d97849386c3e3a756e18a04b48e51" exitCode=255
Jul 08 16:35:01.290371 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:01.290346    2583 scope.go:117] "RemoveContainer" containerID="eff638059b8abdd03a21b811a7246230566d97849386c3e3a756e18a04b48e51"
Jul 08 16:35:01.290653 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:01.290624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" event={"ID":"e15f68d5-4636-447e-b69f-b8a2c9a84c8f","Type":"ContainerDied","Data":"eff638059b8abdd03a21b811a7246230566d97849386c3e3a756e18a04b48e51"}
Jul 08 16:35:02.296717 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.296678    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7" event={"ID":"d46e2dd2-8dd6-43bb-b8ed-5f163e5c8af8","Type":"ContainerStarted","Data":"4f5ccb3494d53dba95ee6a7fe0ea2917500c3847d295584637b4ea8419a5ef0b"}
Jul 08 16:35:02.298650 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.298629    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:35:02.299062 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.299047    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/0.log"
Jul 08 16:35:02.299119 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.299085    2583 generic.go:356] "Generic (PLEG): container finished" podID="e15f68d5-4636-447e-b69f-b8a2c9a84c8f" containerID="69c33816a40829705783e03a3b55bbd7e0cf855cc38a8b91808452ddcd637e6c" exitCode=255
Jul 08 16:35:02.299162 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.299140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" event={"ID":"e15f68d5-4636-447e-b69f-b8a2c9a84c8f","Type":"ContainerDied","Data":"69c33816a40829705783e03a3b55bbd7e0cf855cc38a8b91808452ddcd637e6c"}
Jul 08 16:35:02.299209 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.299199    2583 scope.go:117] "RemoveContainer" containerID="eff638059b8abdd03a21b811a7246230566d97849386c3e3a756e18a04b48e51"
Jul 08 16:35:02.299349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.299337    2583 scope.go:117] "RemoveContainer" containerID="69c33816a40829705783e03a3b55bbd7e0cf855cc38a8b91808452ddcd637e6c"
Jul 08 16:35:02.299529 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:02.299509    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xvsqs_openshift-console-operator(e15f68d5-4636-447e-b69f-b8a2c9a84c8f)\"" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" podUID="e15f68d5-4636-447e-b69f-b8a2c9a84c8f"
Jul 08 16:35:02.365417 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.365351    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zh6r7" podStartSLOduration=1.595854391 podStartE2EDuration="4.365327748s" totalImagesPullingTime="2.769473357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:02.346266678 +0000 UTC m=+59.890619838" watchObservedRunningTime="2026-07-08 16:35:02.365327748 +0000 UTC m=+59.909680897"
Jul 08 16:35:02.365633 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.365614    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8t88b"]
Jul 08 16:35:02.386280 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.386248    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.393256 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.393222    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 16:35:02.393708 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.393681    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 16:35:02.393708 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.393681    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 16:35:02.393876 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.393790    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5r9vg\""
Jul 08 16:35:02.394229 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.394214    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 16:35:02.403623 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.403595    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8t88b"]
Jul 08 16:35:02.542329 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.542290    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.542329 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.542330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9dde7f15-6243-4f8c-af58-7860929b35c5-crio-socket\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.542552 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.542350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.542552 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.542393    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dde7f15-6243-4f8c-af58-7860929b35c5-data-volume\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.542552 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.542443    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76hdp\" (UniqueName: \"kubernetes.io/projected/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-api-access-76hdp\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.643094 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.643027    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.643094 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.643064    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9dde7f15-6243-4f8c-af58-7860929b35c5-crio-socket\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.643094 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.643083    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.643255 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.643098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dde7f15-6243-4f8c-af58-7860929b35c5-data-volume\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.643255 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.643165    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9dde7f15-6243-4f8c-af58-7860929b35c5-crio-socket\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.643255 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:02.643172    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:02.643255 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.643211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76hdp\" (UniqueName: \"kubernetes.io/projected/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-api-access-76hdp\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.643407 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:02.643177    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:02.643407 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:02.643334    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:03.143309123 +0000 UTC m=+60.687662274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:02.643407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.643359    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dde7f15-6243-4f8c-af58-7860929b35c5-data-volume\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:02.643407 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:02.643383    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:03.143368784 +0000 UTC m=+60.687721912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:02.652003 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:02.651975    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76hdp\" (UniqueName: \"kubernetes.io/projected/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-api-access-76hdp\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:03.146867 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:03.146823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:03.146867 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:03.146865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:03.147075 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:03.146981    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:03.147075 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:03.146979    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:03.147075 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:03.147034    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:04.147020761 +0000 UTC m=+61.691373888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:03.147075 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:03.147047    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:04.147041085 +0000 UTC m=+61.691394213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:03.304210 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:03.304184    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:35:03.304623 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:03.304609    2583 scope.go:117] "RemoveContainer" containerID="69c33816a40829705783e03a3b55bbd7e0cf855cc38a8b91808452ddcd637e6c"
Jul 08 16:35:03.304781 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:03.304761    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xvsqs_openshift-console-operator(e15f68d5-4636-447e-b69f-b8a2c9a84c8f)\"" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" podUID="e15f68d5-4636-447e-b69f-b8a2c9a84c8f"
Jul 08 16:35:03.716562 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:03.716537    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pkbl5_85e37108-b3e5-43a9-803f-a409ced780e4/dns-node-resolver/0.log"
Jul 08 16:35:04.112960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.112883    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-6lkqq"]
Jul 08 16:35:04.115531 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.115514    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.118406 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.118380    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 16:35:04.118406 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.118395    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 16:35:04.119834 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.119818    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 16:35:04.119891 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.119819    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gd7cn\""
Jul 08 16:35:04.119891 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.119874    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 16:35:04.124834 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.124814    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-6lkqq"]
Jul 08 16:35:04.157041 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.157010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:04.157041 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.157047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:04.157309 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:04.157142    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:04.157309 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:04.157178    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:04.157309 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:04.157194    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:06.157180456 +0000 UTC m=+63.701533583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:04.157309 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:04.157235    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:06.157219078 +0000 UTC m=+63.701572229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:04.257716 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.257681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/30f711eb-dff1-4ba6-88a6-d8e863c0430d-signing-cabundle\") pod \"service-ca-758f599c5-6lkqq\" (UID: \"30f711eb-dff1-4ba6-88a6-d8e863c0430d\") " pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.257878 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.257731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6xnq\" (UniqueName: \"kubernetes.io/projected/30f711eb-dff1-4ba6-88a6-d8e863c0430d-kube-api-access-t6xnq\") pod \"service-ca-758f599c5-6lkqq\" (UID: \"30f711eb-dff1-4ba6-88a6-d8e863c0430d\") " pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.257878 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.257769    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/30f711eb-dff1-4ba6-88a6-d8e863c0430d-signing-key\") pod \"service-ca-758f599c5-6lkqq\" (UID: \"30f711eb-dff1-4ba6-88a6-d8e863c0430d\") " pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.358294 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.358258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/30f711eb-dff1-4ba6-88a6-d8e863c0430d-signing-key\") pod \"service-ca-758f599c5-6lkqq\" (UID: \"30f711eb-dff1-4ba6-88a6-d8e863c0430d\") " pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.358772 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.358400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/30f711eb-dff1-4ba6-88a6-d8e863c0430d-signing-cabundle\") pod \"service-ca-758f599c5-6lkqq\" (UID: \"30f711eb-dff1-4ba6-88a6-d8e863c0430d\") " pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.358772 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.358432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6xnq\" (UniqueName: \"kubernetes.io/projected/30f711eb-dff1-4ba6-88a6-d8e863c0430d-kube-api-access-t6xnq\") pod \"service-ca-758f599c5-6lkqq\" (UID: \"30f711eb-dff1-4ba6-88a6-d8e863c0430d\") " pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.359113 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.359088    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/30f711eb-dff1-4ba6-88a6-d8e863c0430d-signing-cabundle\") pod \"service-ca-758f599c5-6lkqq\" (UID: \"30f711eb-dff1-4ba6-88a6-d8e863c0430d\") " pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.360797 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.360779    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/30f711eb-dff1-4ba6-88a6-d8e863c0430d-signing-key\") pod \"service-ca-758f599c5-6lkqq\" (UID: \"30f711eb-dff1-4ba6-88a6-d8e863c0430d\") " pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.366697 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.366636    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6xnq\" (UniqueName: \"kubernetes.io/projected/30f711eb-dff1-4ba6-88a6-d8e863c0430d-kube-api-access-t6xnq\") pod \"service-ca-758f599c5-6lkqq\" (UID: \"30f711eb-dff1-4ba6-88a6-d8e863c0430d\") " pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.424416 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.424378    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-6lkqq"
Jul 08 16:35:04.543854 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:04.543814    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-6lkqq"]
Jul 08 16:35:04.546506 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:04.546484    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f711eb_dff1_4ba6_88a6_d8e863c0430d.slice/crio-4d7e82b81429a408413f259dec34f65f0aa44dc9325f96dab75b27d53dbc85ac WatchSource:0}: Error finding container 4d7e82b81429a408413f259dec34f65f0aa44dc9325f96dab75b27d53dbc85ac: Status 404 returned error can't find the container with id 4d7e82b81429a408413f259dec34f65f0aa44dc9325f96dab75b27d53dbc85ac
Jul 08 16:35:05.118146 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:05.118109    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2tlm_3ba94bac-d099-4adc-9ba5-fcaf01ee5f74/node-ca/0.log"
Jul 08 16:35:05.215337 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:05.215307    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6db6r"
Jul 08 16:35:05.312795 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:05.312752    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-6lkqq" event={"ID":"30f711eb-dff1-4ba6-88a6-d8e863c0430d","Type":"ContainerStarted","Data":"4d7e82b81429a408413f259dec34f65f0aa44dc9325f96dab75b27d53dbc85ac"}
Jul 08 16:35:05.723085 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:05.723055    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kxnpg_0d90ba13-50da-4fc8-a242-3d2b776fb911/serve-healthcheck-canary/0.log"
Jul 08 16:35:06.175082 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:06.174988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:06.175082 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:06.175043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:06.175310 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:06.175157    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:06.175310 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:06.175181    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:06.175310 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:06.175233    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:10.175214409 +0000 UTC m=+67.719567539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:06.175310 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:06.175249    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:10.175242466 +0000 UTC m=+67.719595593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:06.318187 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:06.318142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-6lkqq" event={"ID":"30f711eb-dff1-4ba6-88a6-d8e863c0430d","Type":"ContainerStarted","Data":"8023528c467aece71fb16f281f3592b3f8d36573905b01b17e9762fce75f32d4"}
Jul 08 16:35:06.334403 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:06.334352    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-6lkqq" podStartSLOduration=0.70385794 podStartE2EDuration="2.334336511s" totalImagesPullingTime="1.630478571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:06.333933717 +0000 UTC m=+63.878286896" watchObservedRunningTime="2026-07-08 16:35:06.334336511 +0000 UTC m=+63.878689660"
Jul 08 16:35:07.114303 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:07.114065    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:35:07.114775 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:07.114529    2583 scope.go:117] "RemoveContainer" containerID="69c33816a40829705783e03a3b55bbd7e0cf855cc38a8b91808452ddcd637e6c"
Jul 08 16:35:07.114775 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:07.114717    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xvsqs_openshift-console-operator(e15f68d5-4636-447e-b69f-b8a2c9a84c8f)\"" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" podUID="e15f68d5-4636-447e-b69f-b8a2c9a84c8f"
Jul 08 16:35:08.800870 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.800827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:35:08.800870 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.800876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:35:08.804250 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.804222    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 16:35:08.804250 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.804224    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 16:35:08.811686 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:08.811667    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 16:35:08.811802 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:08.811720    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs podName:e1dfe72b-45e2-4611-afd4-f5a04fe89fbc nodeName:}" failed. No retries permitted until 2026-07-08 16:36:12.811705703 +0000 UTC m=+130.356058831 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs") pod "network-metrics-daemon-bmrdj" (UID: "e1dfe72b-45e2-4611-afd4-f5a04fe89fbc") : secret "metrics-daemon-secret" not found
Jul 08 16:35:08.813908 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.813885    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b09743-c5b0-4b1e-82e3-37c9e8e09146-original-pull-secret\") pod \"global-pull-secret-syncer-mt9kk\" (UID: \"a7b09743-c5b0-4b1e-82e3-37c9e8e09146\") " pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:35:08.901892 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.901850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:35:08.904674 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.904640    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85jmw\" (UniqueName: \"kubernetes.io/projected/30ac66b0-607c-4ed9-bdb7-79065051bbb0-kube-api-access-85jmw\") pod \"network-check-target-6ltj4\" (UID: \"30ac66b0-607c-4ed9-bdb7-79065051bbb0\") " pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:35:08.909685 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.909657    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mt9kk"
Jul 08 16:35:08.917937 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.917912    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7mv4\""
Jul 08 16:35:08.926313 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:08.926151    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:35:09.061138 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:09.058442    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mt9kk"]
Jul 08 16:35:09.063472 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:09.063435    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b09743_c5b0_4b1e_82e3_37c9e8e09146.slice/crio-bb4e07bba0172d8c75cc30361afa5091d9d02896e7bb80cf054f419033e8a3bc WatchSource:0}: Error finding container bb4e07bba0172d8c75cc30361afa5091d9d02896e7bb80cf054f419033e8a3bc: Status 404 returned error can't find the container with id bb4e07bba0172d8c75cc30361afa5091d9d02896e7bb80cf054f419033e8a3bc
Jul 08 16:35:09.075805 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:09.075784    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6ltj4"]
Jul 08 16:35:09.078129 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:09.078105    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ac66b0_607c_4ed9_bdb7_79065051bbb0.slice/crio-ba2934468c9778d302276db4c8e5617b85cb28e94d7c2ccc9104500cbde75e2f WatchSource:0}: Error finding container ba2934468c9778d302276db4c8e5617b85cb28e94d7c2ccc9104500cbde75e2f: Status 404 returned error can't find the container with id ba2934468c9778d302276db4c8e5617b85cb28e94d7c2ccc9104500cbde75e2f
Jul 08 16:35:09.103760 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:09.103733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:35:09.103876 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:09.103788    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:35:09.103945 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:09.103902    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:35:09.103945 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:09.103914    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 16:35:09.103945 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:09.103930    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5445697769-jn6vc: secret "image-registry-tls" not found
Jul 08 16:35:09.104053 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:09.103981    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls podName:2b8a2df0-53f6-4d0f-89f5-5b5572ed9384 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:41.103962731 +0000 UTC m=+98.648315859 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls") pod "dns-default-pgpdv" (UID: "2b8a2df0-53f6-4d0f-89f5-5b5572ed9384") : secret "dns-default-metrics-tls" not found
Jul 08 16:35:09.104053 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:09.103996    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls podName:14fac487-6238-415a-a098-0fa02b5375dd nodeName:}" failed. No retries permitted until 2026-07-08 16:35:41.103990133 +0000 UTC m=+98.648343261 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls") pod "image-registry-5445697769-jn6vc" (UID: "14fac487-6238-415a-a098-0fa02b5375dd") : secret "image-registry-tls" not found
Jul 08 16:35:09.328850 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:09.328756    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mt9kk" event={"ID":"a7b09743-c5b0-4b1e-82e3-37c9e8e09146","Type":"ContainerStarted","Data":"bb4e07bba0172d8c75cc30361afa5091d9d02896e7bb80cf054f419033e8a3bc"}
Jul 08 16:35:09.330201 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:09.330167    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6ltj4" event={"ID":"30ac66b0-607c-4ed9-bdb7-79065051bbb0","Type":"ContainerStarted","Data":"b4d44bf9431a75fff8e96a70389284e13af8a96d051e05e4362d3c6c4caea688"}
Jul 08 16:35:09.330317 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:09.330208    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6ltj4" event={"ID":"30ac66b0-607c-4ed9-bdb7-79065051bbb0","Type":"ContainerStarted","Data":"ba2934468c9778d302276db4c8e5617b85cb28e94d7c2ccc9104500cbde75e2f"}
Jul 08 16:35:09.330375 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:09.330313    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:35:09.348672 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:09.348621    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6ltj4" podStartSLOduration=66.348599725 podStartE2EDuration="1m6.348599725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:09.348095619 +0000 UTC m=+66.892448768" watchObservedRunningTime="2026-07-08 16:35:09.348599725 +0000 UTC m=+66.892952875"
Jul 08 16:35:10.213707 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:10.213666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:10.214156 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:10.213730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:10.214156 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:10.213853    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:10.214156 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:10.213870    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:10.214156 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:10.213926    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:18.21391192 +0000 UTC m=+75.758265050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:10.214156 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:10.213940    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls podName:9dde7f15-6243-4f8c-af58-7860929b35c5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:18.21393467 +0000 UTC m=+75.758287802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8t88b" (UID: "9dde7f15-6243-4f8c-af58-7860929b35c5") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:10.285811 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:10.285768    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:35:10.286154 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:10.286142    2583 scope.go:117] "RemoveContainer" containerID="69c33816a40829705783e03a3b55bbd7e0cf855cc38a8b91808452ddcd637e6c"
Jul 08 16:35:10.286307 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:10.286290    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xvsqs_openshift-console-operator(e15f68d5-4636-447e-b69f-b8a2c9a84c8f)\"" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" podUID="e15f68d5-4636-447e-b69f-b8a2c9a84c8f"
Jul 08 16:35:14.350803 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:14.350758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mt9kk" event={"ID":"a7b09743-c5b0-4b1e-82e3-37c9e8e09146","Type":"ContainerStarted","Data":"4be28084c99afc6b4ca4444ef6429a80b4b127539add38d802c600d9e75363df"}
Jul 08 16:35:14.366416 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:14.366363    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mt9kk" podStartSLOduration=67.016051052 podStartE2EDuration="1m11.366350135s" totalImagesPullingTime="4.350299083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:14.365649622 +0000 UTC m=+71.910002771" watchObservedRunningTime="2026-07-08 16:35:14.366350135 +0000 UTC m=+71.910703282"
Jul 08 16:35:18.280968 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:18.280913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:18.281493 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:18.281027    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:18.281648 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:18.281625    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9dde7f15-6243-4f8c-af58-7860929b35c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:18.283349 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:18.283331    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9dde7f15-6243-4f8c-af58-7860929b35c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8t88b\" (UID: \"9dde7f15-6243-4f8c-af58-7860929b35c5\") " pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:18.300279 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:18.300250    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5r9vg\""
Jul 08 16:35:18.307620 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:18.307592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8t88b"
Jul 08 16:35:18.431795 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:18.431767    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8t88b"]
Jul 08 16:35:18.434795 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:18.434759    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dde7f15_6243_4f8c_af58_7860929b35c5.slice/crio-335fbd4397a2843f7bd400228f1173595b658922ec106517da0dcc0356693c7b WatchSource:0}: Error finding container 335fbd4397a2843f7bd400228f1173595b658922ec106517da0dcc0356693c7b: Status 404 returned error can't find the container with id 335fbd4397a2843f7bd400228f1173595b658922ec106517da0dcc0356693c7b
Jul 08 16:35:19.370290 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:19.370198    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8t88b" event={"ID":"9dde7f15-6243-4f8c-af58-7860929b35c5","Type":"ContainerStarted","Data":"335fbd4397a2843f7bd400228f1173595b658922ec106517da0dcc0356693c7b"}
Jul 08 16:35:22.383367 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:22.383272    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8t88b" event={"ID":"9dde7f15-6243-4f8c-af58-7860929b35c5","Type":"ContainerStarted","Data":"9b56724dc20eac5ac4de3bf77c93c4b1567b134643e5dac650a890c400c0d5f2"}
Jul 08 16:35:23.387868 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:23.387831    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8t88b" event={"ID":"9dde7f15-6243-4f8c-af58-7860929b35c5","Type":"ContainerStarted","Data":"39d0903f6457f40ea93d408e55add2f41a32a9fbd17bfaaa4a6c42a29270c52b"}
Jul 08 16:35:25.000543 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:25.000394    2583 scope.go:117] "RemoveContainer" containerID="69c33816a40829705783e03a3b55bbd7e0cf855cc38a8b91808452ddcd637e6c"
Jul 08 16:35:26.400313 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:26.400275    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8t88b" event={"ID":"9dde7f15-6243-4f8c-af58-7860929b35c5","Type":"ContainerStarted","Data":"495921d005a1d82fa16a41c314eff9e05845fbc549dcbb62e75c09f7cebf0ca1"}
Jul 08 16:35:26.402008 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:26.401986    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:35:26.402283 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:26.402042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs" event={"ID":"e15f68d5-4636-447e-b69f-b8a2c9a84c8f","Type":"ContainerStarted","Data":"2381d589fde4f00daee1029948d61f5c3ad2019aa09a7969efb966fe646aa516"}
Jul 08 16:35:26.402506 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:26.402483    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:35:26.407373 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:26.407349    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-xvsqs"
Jul 08 16:35:26.434263 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:26.434202    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8t88b" podStartSLOduration=17.231743432 podStartE2EDuration="24.434178648s" totalImagesPullingTime="7.202435216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:35:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:26.433045805 +0000 UTC m=+83.977398955" watchObservedRunningTime="2026-07-08 16:35:26.434178648 +0000 UTC m=+83.978531798"
Jul 08 16:35:27.863477 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.862377    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"]
Jul 08 16:35:27.866842 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.866811    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"]
Jul 08 16:35:27.866962 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.866936    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"
Jul 08 16:35:27.869585 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.869567    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 08 16:35:27.869870 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.869855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:27.869965 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.869943    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ls869\""
Jul 08 16:35:27.871297 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.871274    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 08 16:35:27.874088 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.874067    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 16:35:27.874399 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.874297    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 16:35:27.874399 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.874324    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 16:35:27.874399 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.874298    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 16:35:27.874399 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.874333    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 16:35:27.874727 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.874360    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 16:35:27.874727 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.874637    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 16:35:27.875724 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.875706    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"]
Jul 08 16:35:27.878942 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.878922    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"]
Jul 08 16:35:27.882052 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.882037    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"
Jul 08 16:35:27.884428 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.884398    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pphpx\""
Jul 08 16:35:27.884494 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.884467    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 16:35:27.886952 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.886936    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"]
Jul 08 16:35:27.891075 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.891054    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"]
Jul 08 16:35:27.961368 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:27.961546 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhjw8\" (UniqueName: \"kubernetes.io/projected/c2661884-1f0f-4a45-956c-73fd0d1a973b-kube-api-access-rhjw8\") pod \"managed-serviceaccount-addon-agent-6c74484f5b-xgn55\" (UID: \"c2661884-1f0f-4a45-956c-73fd0d1a973b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"
Jul 08 16:35:27.961546 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961416    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2661884-1f0f-4a45-956c-73fd0d1a973b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c74484f5b-xgn55\" (UID: \"c2661884-1f0f-4a45-956c-73fd0d1a973b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"
Jul 08 16:35:27.961546 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4323d253-8257-4561-94ff-60428ed685da-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rbhsp\" (UID: \"4323d253-8257-4561-94ff-60428ed685da\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"
Jul 08 16:35:27.961546 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961504    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-ca\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:27.961737 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4323d253-8257-4561-94ff-60428ed685da-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rbhsp\" (UID: \"4323d253-8257-4561-94ff-60428ed685da\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"
Jul 08 16:35:27.961737 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961608    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-hub\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:27.961737 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:27.961880 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961750    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:27.961880 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:27.961784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc7g9\" (UniqueName: \"kubernetes.io/projected/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-kube-api-access-nc7g9\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.062530 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-hub\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.062530 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.062765 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.062765 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc7g9\" (UniqueName: \"kubernetes.io/projected/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-kube-api-access-nc7g9\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.062881 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.062881 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhjw8\" (UniqueName: \"kubernetes.io/projected/c2661884-1f0f-4a45-956c-73fd0d1a973b-kube-api-access-rhjw8\") pod \"managed-serviceaccount-addon-agent-6c74484f5b-xgn55\" (UID: \"c2661884-1f0f-4a45-956c-73fd0d1a973b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"
Jul 08 16:35:28.062881 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2661884-1f0f-4a45-956c-73fd0d1a973b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c74484f5b-xgn55\" (UID: \"c2661884-1f0f-4a45-956c-73fd0d1a973b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"
Jul 08 16:35:28.063038 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4323d253-8257-4561-94ff-60428ed685da-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rbhsp\" (UID: \"4323d253-8257-4561-94ff-60428ed685da\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"
Jul 08 16:35:28.063038 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-ca\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.063038 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.062960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4323d253-8257-4561-94ff-60428ed685da-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rbhsp\" (UID: \"4323d253-8257-4561-94ff-60428ed685da\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"
Jul 08 16:35:28.063965 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.063919    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4323d253-8257-4561-94ff-60428ed685da-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rbhsp\" (UID: \"4323d253-8257-4561-94ff-60428ed685da\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"
Jul 08 16:35:28.064575 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.064554    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.066082 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.066036    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.066184 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.066145    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-hub\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.066240 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.066198    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-ca\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.066240 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.066222    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.066412 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.066395    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2661884-1f0f-4a45-956c-73fd0d1a973b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c74484f5b-xgn55\" (UID: \"c2661884-1f0f-4a45-956c-73fd0d1a973b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"
Jul 08 16:35:28.067405 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.067389    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4323d253-8257-4561-94ff-60428ed685da-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rbhsp\" (UID: \"4323d253-8257-4561-94ff-60428ed685da\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"
Jul 08 16:35:28.082226 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.082200    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc7g9\" (UniqueName: \"kubernetes.io/projected/f80ca501-8ce0-4d8e-93f8-3f04d2f7e962-kube-api-access-nc7g9\") pod \"cluster-proxy-proxy-agent-7d77c68497-wt2x8\" (UID: \"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.082327 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.082273    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhjw8\" (UniqueName: \"kubernetes.io/projected/c2661884-1f0f-4a45-956c-73fd0d1a973b-kube-api-access-rhjw8\") pod \"managed-serviceaccount-addon-agent-6c74484f5b-xgn55\" (UID: \"c2661884-1f0f-4a45-956c-73fd0d1a973b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"
Jul 08 16:35:28.177534 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.177426    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"
Jul 08 16:35:28.191620 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.191594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"
Jul 08 16:35:28.198932 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.198911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"
Jul 08 16:35:28.332375 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.332338    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp"]
Jul 08 16:35:28.335779 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:28.335731    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4323d253_8257_4561_94ff_60428ed685da.slice/crio-ff5eaf501d45643707fbb8844b2595cd4b049fdf0ce06c51f79c28fcc518994e WatchSource:0}: Error finding container ff5eaf501d45643707fbb8844b2595cd4b049fdf0ce06c51f79c28fcc518994e: Status 404 returned error can't find the container with id ff5eaf501d45643707fbb8844b2595cd4b049fdf0ce06c51f79c28fcc518994e
Jul 08 16:35:28.408535 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.408498    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp" event={"ID":"4323d253-8257-4561-94ff-60428ed685da","Type":"ContainerStarted","Data":"ff5eaf501d45643707fbb8844b2595cd4b049fdf0ce06c51f79c28fcc518994e"}
Jul 08 16:35:28.560645 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.560624    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8"]
Jul 08 16:35:28.563191 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:28.563163    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55"]
Jul 08 16:35:28.563447 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:28.563427    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf80ca501_8ce0_4d8e_93f8_3f04d2f7e962.slice/crio-74a9d139feea947bdcc65191d23097e15baf9689bd6e387bb13c732d894dff04 WatchSource:0}: Error finding container 74a9d139feea947bdcc65191d23097e15baf9689bd6e387bb13c732d894dff04: Status 404 returned error can't find the container with id 74a9d139feea947bdcc65191d23097e15baf9689bd6e387bb13c732d894dff04
Jul 08 16:35:28.566177 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:28.566153    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2661884_1f0f_4a45_956c_73fd0d1a973b.slice/crio-4f0a71c22f63b281790a6310b0e59a2272ce31e32d66c3a34b0e0eb841fb99de WatchSource:0}: Error finding container 4f0a71c22f63b281790a6310b0e59a2272ce31e32d66c3a34b0e0eb841fb99de: Status 404 returned error can't find the container with id 4f0a71c22f63b281790a6310b0e59a2272ce31e32d66c3a34b0e0eb841fb99de
Jul 08 16:35:29.420472 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:29.420381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8" event={"ID":"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962","Type":"ContainerStarted","Data":"74a9d139feea947bdcc65191d23097e15baf9689bd6e387bb13c732d894dff04"}
Jul 08 16:35:29.422482 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:29.422404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55" event={"ID":"c2661884-1f0f-4a45-956c-73fd0d1a973b","Type":"ContainerStarted","Data":"4f0a71c22f63b281790a6310b0e59a2272ce31e32d66c3a34b0e0eb841fb99de"}
Jul 08 16:35:33.452594 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:33.452561    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp" event={"ID":"4323d253-8257-4561-94ff-60428ed685da","Type":"ContainerStarted","Data":"d3389aaf7526c8618d1e889b4c67aeee0ffc282f8ad60ba907078f1ad98d2c20"}
Jul 08 16:35:33.454505 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:33.454479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8" event={"ID":"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962","Type":"ContainerStarted","Data":"d67d056d908bde17a3f782a6330a5da43e1976ef971e82cb2412f9e47c1c2439"}
Jul 08 16:35:33.454617 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:33.454515    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8" event={"ID":"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962","Type":"ContainerStarted","Data":"ab7319ec1a4653322fd30dbc5031380ed1c3285c16301d1e25b6e29e2154b289"}
Jul 08 16:35:33.454617 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:33.454530    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8" event={"ID":"f80ca501-8ce0-4d8e-93f8-3f04d2f7e962","Type":"ContainerStarted","Data":"2c3b0c7b87405d4e3fcfe44cf190c0b3bb8c9915b5ba0def8322f758d2a18cbe"}
Jul 08 16:35:33.455822 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:33.455792    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55" event={"ID":"c2661884-1f0f-4a45-956c-73fd0d1a973b","Type":"ContainerStarted","Data":"74c7dbf7f090ff9b1a1844867144efe4a6b1b9fc3345b2eb96d5bc9d20f7719f"}
Jul 08 16:35:33.469994 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:33.469947    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rbhsp" podStartSLOduration=2.417770268 podStartE2EDuration="6.469933202s" totalImagesPullingTime="4.052162934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:33.469332599 +0000 UTC m=+91.013685749" watchObservedRunningTime="2026-07-08 16:35:33.469933202 +0000 UTC m=+91.014286350"
Jul 08 16:35:33.490175 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:33.490127    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c74484f5b-xgn55" podStartSLOduration=2.65914584 podStartE2EDuration="6.490111766s" totalImagesPullingTime="3.830965926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:33.489323491 +0000 UTC m=+91.033676642" watchObservedRunningTime="2026-07-08 16:35:33.490111766 +0000 UTC m=+91.034464916"
Jul 08 16:35:33.513562 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:33.513516    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d77c68497-wt2x8" podStartSLOduration=2.666624368 podStartE2EDuration="6.513502272s" totalImagesPullingTime="3.846877904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:33.513122605 +0000 UTC m=+91.057475753" watchObservedRunningTime="2026-07-08 16:35:33.513502272 +0000 UTC m=+91.057855421"
Jul 08 16:35:40.337017 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:40.336984    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6ltj4"
Jul 08 16:35:41.173293 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.173252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:35:41.173481 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.173304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:35:41.175801 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.175772    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"image-registry-5445697769-jn6vc\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") " pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:35:41.175899 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.175772    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b8a2df0-53f6-4d0f-89f5-5b5572ed9384-metrics-tls\") pod \"dns-default-pgpdv\" (UID: \"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384\") " pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:35:41.442519 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.442494    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqktz\""
Jul 08 16:35:41.450539 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.450510    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:35:41.456179 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.456164    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jflkn\""
Jul 08 16:35:41.464516 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.464497    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:35:41.591904 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.591876    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5445697769-jn6vc"]
Jul 08 16:35:41.594715 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:41.594687    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fac487_6238_415a_a098_0fa02b5375dd.slice/crio-17bd2c83e3b13fa681c400a4e510027afac3948670b071fc422f9a4806c25453 WatchSource:0}: Error finding container 17bd2c83e3b13fa681c400a4e510027afac3948670b071fc422f9a4806c25453: Status 404 returned error can't find the container with id 17bd2c83e3b13fa681c400a4e510027afac3948670b071fc422f9a4806c25453
Jul 08 16:35:41.606721 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:41.606699    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pgpdv"]
Jul 08 16:35:41.609286 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:41.609263    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8a2df0_53f6_4d0f_89f5_5b5572ed9384.slice/crio-9e099d6983d6d48e0568766a74ff30b66ec29a9fed1a48aebd46c704632e28a5 WatchSource:0}: Error finding container 9e099d6983d6d48e0568766a74ff30b66ec29a9fed1a48aebd46c704632e28a5: Status 404 returned error can't find the container with id 9e099d6983d6d48e0568766a74ff30b66ec29a9fed1a48aebd46c704632e28a5
Jul 08 16:35:42.487473 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:42.487421    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgpdv" event={"ID":"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384","Type":"ContainerStarted","Data":"9e099d6983d6d48e0568766a74ff30b66ec29a9fed1a48aebd46c704632e28a5"}
Jul 08 16:35:42.489077 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:42.489039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5445697769-jn6vc" event={"ID":"14fac487-6238-415a-a098-0fa02b5375dd","Type":"ContainerStarted","Data":"5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b"}
Jul 08 16:35:42.489206 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:42.489084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5445697769-jn6vc" event={"ID":"14fac487-6238-415a-a098-0fa02b5375dd","Type":"ContainerStarted","Data":"17bd2c83e3b13fa681c400a4e510027afac3948670b071fc422f9a4806c25453"}
Jul 08 16:35:42.489206 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:42.489186    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:35:43.493968 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:43.493929    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgpdv" event={"ID":"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384","Type":"ContainerStarted","Data":"70c6028b6db2b63ce90d8ed8da25c08cf608f5b0749842146403f045494c6c0f"}
Jul 08 16:35:43.494418 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:43.494021    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pgpdv" event={"ID":"2b8a2df0-53f6-4d0f-89f5-5b5572ed9384","Type":"ContainerStarted","Data":"4c87ec50cc5895cf9f066e48083ae70f1be35f14e179d66efa59d75f61f045e7"}
Jul 08 16:35:43.494418 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:43.494251    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:35:43.514319 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:43.514273    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5445697769-jn6vc" podStartSLOduration=100.514260291 podStartE2EDuration="1m40.514260291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:42.551974157 +0000 UTC m=+100.096327307" watchObservedRunningTime="2026-07-08 16:35:43.514260291 +0000 UTC m=+101.058613440"
Jul 08 16:35:43.514488 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:43.514368    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pgpdv" podStartSLOduration=64.949293838 podStartE2EDuration="1m6.514363756s" totalImagesPullingTime="1.565069918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:43.512814939 +0000 UTC m=+101.057168110" watchObservedRunningTime="2026-07-08 16:35:43.514363756 +0000 UTC m=+101.058716904"
Jul 08 16:35:46.514414 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.514379    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jtbx6"]
Jul 08 16:35:46.518028 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.518009    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.521414 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.521238    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8djnp\""
Jul 08 16:35:46.521414 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.521343    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 16:35:46.521636 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.521501    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 16:35:46.522268 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.522245    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 16:35:46.522375 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.522283    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 16:35:46.522375 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.522294    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 16:35:46.522659 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.522642    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 16:35:46.615008 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.614976    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-accelerators-collector-config\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.615202 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.615026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-tls\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.615202 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.615048    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91442f06-67b3-4869-aa22-b5d9f12e8b64-root\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.615202 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.615101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-wtmp\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.615326 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.615207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91442f06-67b3-4869-aa22-b5d9f12e8b64-metrics-client-ca\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.615326 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.615230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.615326 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.615250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91442f06-67b3-4869-aa22-b5d9f12e8b64-sys\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.615326 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.615277    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-textfile\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.615326 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.615297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvht\" (UniqueName: \"kubernetes.io/projected/91442f06-67b3-4869-aa22-b5d9f12e8b64-kube-api-access-9dvht\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.715993 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.715959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91442f06-67b3-4869-aa22-b5d9f12e8b64-metrics-client-ca\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.715993 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.715995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716232 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91442f06-67b3-4869-aa22-b5d9f12e8b64-sys\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716232 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716051    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-textfile\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716232 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716074    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvht\" (UniqueName: \"kubernetes.io/projected/91442f06-67b3-4869-aa22-b5d9f12e8b64-kube-api-access-9dvht\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716232 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-accelerators-collector-config\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716232 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716124    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91442f06-67b3-4869-aa22-b5d9f12e8b64-sys\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716232 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-tls\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716232 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91442f06-67b3-4869-aa22-b5d9f12e8b64-root\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716232 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:46.716223    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 16:35:46.716660 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716240    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-wtmp\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716660 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716286    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91442f06-67b3-4869-aa22-b5d9f12e8b64-root\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716660 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:35:46.716393    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-tls podName:91442f06-67b3-4869-aa22-b5d9f12e8b64 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:47.216351915 +0000 UTC m=+104.760705043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-tls") pod "node-exporter-jtbx6" (UID: "91442f06-67b3-4869-aa22-b5d9f12e8b64") : secret "node-exporter-tls" not found
Jul 08 16:35:46.716660 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716415    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-wtmp\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716660 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716497    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-textfile\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.716897 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.716674    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91442f06-67b3-4869-aa22-b5d9f12e8b64-metrics-client-ca\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.717080 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.717060    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-accelerators-collector-config\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.718883 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.718842    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:46.724918 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:46.724893    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvht\" (UniqueName: \"kubernetes.io/projected/91442f06-67b3-4869-aa22-b5d9f12e8b64-kube-api-access-9dvht\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:47.221546 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:47.221511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-tls\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:47.223889 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:47.223870    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91442f06-67b3-4869-aa22-b5d9f12e8b64-node-exporter-tls\") pod \"node-exporter-jtbx6\" (UID: \"91442f06-67b3-4869-aa22-b5d9f12e8b64\") " pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:47.429932 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:47.429897    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jtbx6"
Jul 08 16:35:47.458936 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:35:47.458903    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91442f06_67b3_4869_aa22_b5d9f12e8b64.slice/crio-b7bee2cc79570961e99e20173988482c1905a79481258adf9baa4723613c262a WatchSource:0}: Error finding container b7bee2cc79570961e99e20173988482c1905a79481258adf9baa4723613c262a: Status 404 returned error can't find the container with id b7bee2cc79570961e99e20173988482c1905a79481258adf9baa4723613c262a
Jul 08 16:35:47.515000 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:47.514917    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jtbx6" event={"ID":"91442f06-67b3-4869-aa22-b5d9f12e8b64","Type":"ContainerStarted","Data":"b7bee2cc79570961e99e20173988482c1905a79481258adf9baa4723613c262a"}
Jul 08 16:35:49.524597 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:49.524557    2583 generic.go:356] "Generic (PLEG): container finished" podID="91442f06-67b3-4869-aa22-b5d9f12e8b64" containerID="4f247685e641cf5d8ea86b7e7b48ad32e34e01e53fb62fc058602ab3973f5773" exitCode=0
Jul 08 16:35:49.524994 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:49.524650    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jtbx6" event={"ID":"91442f06-67b3-4869-aa22-b5d9f12e8b64","Type":"ContainerDied","Data":"4f247685e641cf5d8ea86b7e7b48ad32e34e01e53fb62fc058602ab3973f5773"}
Jul 08 16:35:50.530151 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:50.530115    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jtbx6" event={"ID":"91442f06-67b3-4869-aa22-b5d9f12e8b64","Type":"ContainerStarted","Data":"3e9f5d43e1826d7608507835367e3dfc9ec9534057ca0a15799a1e72c260691a"}
Jul 08 16:35:50.530554 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:50.530165    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jtbx6" event={"ID":"91442f06-67b3-4869-aa22-b5d9f12e8b64","Type":"ContainerStarted","Data":"6250c590c3fd092369727142fb70f09fba07b29ce9a6f9352508a14c042ee924"}
Jul 08 16:35:50.553973 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:50.553924    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jtbx6" podStartSLOduration=3.358056646 podStartE2EDuration="4.5539089s" totalImagesPullingTime="1.126154229s" totalInitContainerRuntime="69.698025ms" isStatefulPod=true podCreationTimestamp="2026-07-08 16:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:50.552542156 +0000 UTC m=+108.096895304" watchObservedRunningTime="2026-07-08 16:35:50.5539089 +0000 UTC m=+108.098262048"
Jul 08 16:35:53.121429 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:53.121395    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5445697769-jn6vc"]
Jul 08 16:35:53.500155 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:35:53.500123    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pgpdv"
Jul 08 16:36:03.127157 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:03.127122    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:36:11.602378 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:11.602343    2583 generic.go:356] "Generic (PLEG): container finished" podID="e145071b-da47-4529-8166-af9fce467d01" containerID="3bdb2d4b0a15af9819f3ae62b633f7c6ce48809aa5e9d3f010988faeff66e9ee" exitCode=0
Jul 08 16:36:11.602747 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:11.602400    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v" event={"ID":"e145071b-da47-4529-8166-af9fce467d01","Type":"ContainerDied","Data":"3bdb2d4b0a15af9819f3ae62b633f7c6ce48809aa5e9d3f010988faeff66e9ee"}
Jul 08 16:36:11.602747 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:11.602704    2583 scope.go:117] "RemoveContainer" containerID="3bdb2d4b0a15af9819f3ae62b633f7c6ce48809aa5e9d3f010988faeff66e9ee"
Jul 08 16:36:12.607594 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:12.607563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-psq6v" event={"ID":"e145071b-da47-4529-8166-af9fce467d01","Type":"ContainerStarted","Data":"0b8a3f3ac6b5cb8bd645b476f01c1484baede5c06fa4a9b04b1a8f8250429286"}
Jul 08 16:36:12.906029 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:12.905945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:36:12.908287 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:12.908262    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1dfe72b-45e2-4611-afd4-f5a04fe89fbc-metrics-certs\") pod \"network-metrics-daemon-bmrdj\" (UID: \"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc\") " pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:36:13.123157 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:13.123121    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-krkqn\""
Jul 08 16:36:13.131407 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:13.131384    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmrdj"
Jul 08 16:36:13.256234 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:13.256152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bmrdj"]
Jul 08 16:36:13.260282 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:36:13.260249    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1dfe72b_45e2_4611_afd4_f5a04fe89fbc.slice/crio-eb14b1dcccd5975403eb92f4ca57566c7e6d2b4f48c9cdc3d87d383e2eba9be1 WatchSource:0}: Error finding container eb14b1dcccd5975403eb92f4ca57566c7e6d2b4f48c9cdc3d87d383e2eba9be1: Status 404 returned error can't find the container with id eb14b1dcccd5975403eb92f4ca57566c7e6d2b4f48c9cdc3d87d383e2eba9be1
Jul 08 16:36:13.612293 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:13.612260    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bmrdj" event={"ID":"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc","Type":"ContainerStarted","Data":"eb14b1dcccd5975403eb92f4ca57566c7e6d2b4f48c9cdc3d87d383e2eba9be1"}
Jul 08 16:36:14.617927 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:14.617835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bmrdj" event={"ID":"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc","Type":"ContainerStarted","Data":"02071cabb65dcaabec4f16cbf27fd421ba89c475020959ff9d13e3ca54ed153c"}
Jul 08 16:36:14.617927 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:14.617884    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bmrdj" event={"ID":"e1dfe72b-45e2-4611-afd4-f5a04fe89fbc","Type":"ContainerStarted","Data":"2a9a94064ceaa767ecdd16d2e40e16e96bc12b6361dded908e885106eb158789"}
Jul 08 16:36:14.639600 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:14.638075    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bmrdj" podStartSLOduration=130.574396803 podStartE2EDuration="2m11.638050127s" totalImagesPullingTime="1.063653324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:36:14.635884229 +0000 UTC m=+132.180237376" watchObservedRunningTime="2026-07-08 16:36:14.638050127 +0000 UTC m=+132.182403277"
Jul 08 16:36:18.141284 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.141241    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5445697769-jn6vc" podUID="14fac487-6238-415a-a098-0fa02b5375dd" containerName="registry" containerID="cri-o://5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b" gracePeriod=30
Jul 08 16:36:18.375087 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.375064    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:36:18.441226 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441189    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-trusted-ca\") pod \"14fac487-6238-415a-a098-0fa02b5375dd\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") "
Jul 08 16:36:18.441226 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441224    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") pod \"14fac487-6238-415a-a098-0fa02b5375dd\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") "
Jul 08 16:36:18.441440 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441258    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/14fac487-6238-415a-a098-0fa02b5375dd-ca-trust-extracted\") pod \"14fac487-6238-415a-a098-0fa02b5375dd\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") "
Jul 08 16:36:18.441440 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441289    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-image-registry-private-configuration\") pod \"14fac487-6238-415a-a098-0fa02b5375dd\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") "
Jul 08 16:36:18.441582 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441431    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-registry-certificates\") pod \"14fac487-6238-415a-a098-0fa02b5375dd\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") "
Jul 08 16:36:18.441582 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441536    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-bound-sa-token\") pod \"14fac487-6238-415a-a098-0fa02b5375dd\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") "
Jul 08 16:36:18.441582 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441577    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-installation-pull-secrets\") pod \"14fac487-6238-415a-a098-0fa02b5375dd\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") "
Jul 08 16:36:18.441712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441603    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd48z\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-kube-api-access-fd48z\") pod \"14fac487-6238-415a-a098-0fa02b5375dd\" (UID: \"14fac487-6238-415a-a098-0fa02b5375dd\") "
Jul 08 16:36:18.441795 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441768    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "14fac487-6238-415a-a098-0fa02b5375dd" (UID: "14fac487-6238-415a-a098-0fa02b5375dd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:36:18.441864 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.441808    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "14fac487-6238-415a-a098-0fa02b5375dd" (UID: "14fac487-6238-415a-a098-0fa02b5375dd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:36:18.444097 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.444065    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "14fac487-6238-415a-a098-0fa02b5375dd" (UID: "14fac487-6238-415a-a098-0fa02b5375dd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:36:18.444218 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.444103    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "14fac487-6238-415a-a098-0fa02b5375dd" (UID: "14fac487-6238-415a-a098-0fa02b5375dd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:36:18.444218 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.444108    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-kube-api-access-fd48z" (OuterVolumeSpecName: "kube-api-access-fd48z") pod "14fac487-6238-415a-a098-0fa02b5375dd" (UID: "14fac487-6238-415a-a098-0fa02b5375dd"). InnerVolumeSpecName "kube-api-access-fd48z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:36:18.444294 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.444270    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "14fac487-6238-415a-a098-0fa02b5375dd" (UID: "14fac487-6238-415a-a098-0fa02b5375dd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:36:18.444505 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.444487    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "14fac487-6238-415a-a098-0fa02b5375dd" (UID: "14fac487-6238-415a-a098-0fa02b5375dd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:36:18.449692 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.449668    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fac487-6238-415a-a098-0fa02b5375dd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "14fac487-6238-415a-a098-0fa02b5375dd" (UID: "14fac487-6238-415a-a098-0fa02b5375dd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:36:18.542433 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.542398    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-bound-sa-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:36:18.542433 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.542427    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-installation-pull-secrets\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:36:18.542433 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.542437    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd48z\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-kube-api-access-fd48z\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:36:18.542433 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.542446    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-trusted-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:36:18.542763 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.542476    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/14fac487-6238-415a-a098-0fa02b5375dd-registry-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:36:18.542763 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.542484    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/14fac487-6238-415a-a098-0fa02b5375dd-ca-trust-extracted\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:36:18.542763 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.542494    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/14fac487-6238-415a-a098-0fa02b5375dd-image-registry-private-configuration\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:36:18.542763 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.542502    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/14fac487-6238-415a-a098-0fa02b5375dd-registry-certificates\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:36:18.632616 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.632583    2583 generic.go:356] "Generic (PLEG): container finished" podID="14fac487-6238-415a-a098-0fa02b5375dd" containerID="5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b" exitCode=0
Jul 08 16:36:18.632779 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.632629    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5445697769-jn6vc"
Jul 08 16:36:18.632779 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.632674    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5445697769-jn6vc" event={"ID":"14fac487-6238-415a-a098-0fa02b5375dd","Type":"ContainerDied","Data":"5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b"}
Jul 08 16:36:18.632779 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.632728    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5445697769-jn6vc" event={"ID":"14fac487-6238-415a-a098-0fa02b5375dd","Type":"ContainerDied","Data":"17bd2c83e3b13fa681c400a4e510027afac3948670b071fc422f9a4806c25453"}
Jul 08 16:36:18.632779 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.632754    2583 scope.go:117] "RemoveContainer" containerID="5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b"
Jul 08 16:36:18.641082 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.641067    2583 scope.go:117] "RemoveContainer" containerID="5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b"
Jul 08 16:36:18.641345 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:36:18.641326    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b\": container with ID starting with 5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b not found: ID does not exist" containerID="5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b"
Jul 08 16:36:18.641391 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.641354    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b"} err="failed to get container status \"5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b\": rpc error: code = NotFound desc = could not find container \"5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b\": container with ID starting with 5dd22da3097d1b25bd8430ba193b04866dba7556f8ed8017884b1635d61e232b not found: ID does not exist"
Jul 08 16:36:18.652846 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.652818    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5445697769-jn6vc"]
Jul 08 16:36:18.656253 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:18.656233    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5445697769-jn6vc"]
Jul 08 16:36:19.004650 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:36:19.004616    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14fac487-6238-415a-a098-0fa02b5375dd" path="/var/lib/kubelet/pods/14fac487-6238-415a-a098-0fa02b5375dd/volumes"
Jul 08 16:39:02.888532 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:39:02.888505    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:39:02.892722 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:39:02.892702    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:39:02.893213 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:39:02.893185    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:39:02.897243 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:39:02.897227    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 16:39:02.897553 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:39:02.897540    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:42:06.343828 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.343793    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"]
Jul 08 16:42:06.344280 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.344048    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14fac487-6238-415a-a098-0fa02b5375dd" containerName="registry"
Jul 08 16:42:06.344280 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.344059    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fac487-6238-415a-a098-0fa02b5375dd" containerName="registry"
Jul 08 16:42:06.344280 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.344113    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="14fac487-6238-415a-a098-0fa02b5375dd" containerName="registry"
Jul 08 16:42:06.346687 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.346672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:06.349262 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.349241    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-4wzhh\""
Jul 08 16:42:06.349386 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.349370    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 08 16:42:06.349526 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.349503    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 08 16:42:06.349635 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.349544    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 08 16:42:06.365627 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.365600    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"]
Jul 08 16:42:06.417313 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.417280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-858g6\" (UniqueName: \"kubernetes.io/projected/22901ced-ba1a-4589-9138-f10c5a470093-kube-api-access-858g6\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n\" (UID: \"22901ced-ba1a-4589-9138-f10c5a470093\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:06.417493 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.417321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/22901ced-ba1a-4589-9138-f10c5a470093-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n\" (UID: \"22901ced-ba1a-4589-9138-f10c5a470093\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:06.518335 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.518299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/22901ced-ba1a-4589-9138-f10c5a470093-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n\" (UID: \"22901ced-ba1a-4589-9138-f10c5a470093\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:06.518552 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.518359    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-858g6\" (UniqueName: \"kubernetes.io/projected/22901ced-ba1a-4589-9138-f10c5a470093-kube-api-access-858g6\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n\" (UID: \"22901ced-ba1a-4589-9138-f10c5a470093\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:06.520835 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.520801    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/22901ced-ba1a-4589-9138-f10c5a470093-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n\" (UID: \"22901ced-ba1a-4589-9138-f10c5a470093\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:06.527328 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.527304    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-858g6\" (UniqueName: \"kubernetes.io/projected/22901ced-ba1a-4589-9138-f10c5a470093-kube-api-access-858g6\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n\" (UID: \"22901ced-ba1a-4589-9138-f10c5a470093\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:06.660167 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.660075    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:06.796211 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.796177    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"]
Jul 08 16:42:06.799616 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:42:06.799590    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22901ced_ba1a_4589_9138_f10c5a470093.slice/crio-1c65c58658fb183b55add6791c6e64dc0042e8290eb357a59fa6e48b0193a459 WatchSource:0}: Error finding container 1c65c58658fb183b55add6791c6e64dc0042e8290eb357a59fa6e48b0193a459: Status 404 returned error can't find the container with id 1c65c58658fb183b55add6791c6e64dc0042e8290eb357a59fa6e48b0193a459
Jul 08 16:42:06.801937 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.801920    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:42:06.807960 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:06.807930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n" event={"ID":"22901ced-ba1a-4589-9138-f10c5a470093","Type":"ContainerStarted","Data":"1c65c58658fb183b55add6791c6e64dc0042e8290eb357a59fa6e48b0193a459"}
Jul 08 16:42:10.825527 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:10.825484    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n" event={"ID":"22901ced-ba1a-4589-9138-f10c5a470093","Type":"ContainerStarted","Data":"48aef0d12cda37e373299b25f6df39ea0b4db568e890e71ef860f868554d5dfe"}
Jul 08 16:42:10.825894 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:10.825690    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:10.859831 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:10.859781    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n" podStartSLOduration=1.601558658 podStartE2EDuration="4.859760317s" totalImagesPullingTime="3.258201659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:42:10.857916282 +0000 UTC m=+488.402269432" watchObservedRunningTime="2026-07-08 16:42:10.859760317 +0000 UTC m=+488.404113470"
Jul 08 16:42:11.779777 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.779738    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-9ns26"]
Jul 08 16:42:11.783164 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.783143    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:11.785500 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.785477    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 08 16:42:11.785691 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.785588    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 08 16:42:11.785691 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.785609    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-xvhp6\""
Jul 08 16:42:11.791893 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.791865    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-9ns26"]
Jul 08 16:42:11.860222 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.860191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b82381b1-ac53-4f93-8b0d-bfbffe8941ca-certificates\") pod \"keda-admission-5fbd5c4644-9ns26\" (UID: \"b82381b1-ac53-4f93-8b0d-bfbffe8941ca\") " pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:11.860222 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.860220    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf6pz\" (UniqueName: \"kubernetes.io/projected/b82381b1-ac53-4f93-8b0d-bfbffe8941ca-kube-api-access-hf6pz\") pod \"keda-admission-5fbd5c4644-9ns26\" (UID: \"b82381b1-ac53-4f93-8b0d-bfbffe8941ca\") " pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:11.961567 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.961519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b82381b1-ac53-4f93-8b0d-bfbffe8941ca-certificates\") pod \"keda-admission-5fbd5c4644-9ns26\" (UID: \"b82381b1-ac53-4f93-8b0d-bfbffe8941ca\") " pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:11.961567 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.961554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf6pz\" (UniqueName: \"kubernetes.io/projected/b82381b1-ac53-4f93-8b0d-bfbffe8941ca-kube-api-access-hf6pz\") pod \"keda-admission-5fbd5c4644-9ns26\" (UID: \"b82381b1-ac53-4f93-8b0d-bfbffe8941ca\") " pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:11.961833 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:42:11.961703    2583 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 08 16:42:11.961833 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:42:11.961745    2583 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-9ns26: secret "keda-admission-webhooks-certs" not found
Jul 08 16:42:11.961833 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:42:11.961802    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b82381b1-ac53-4f93-8b0d-bfbffe8941ca-certificates podName:b82381b1-ac53-4f93-8b0d-bfbffe8941ca nodeName:}" failed. No retries permitted until 2026-07-08 16:42:12.46178224 +0000 UTC m=+490.006135384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/b82381b1-ac53-4f93-8b0d-bfbffe8941ca-certificates") pod "keda-admission-5fbd5c4644-9ns26" (UID: "b82381b1-ac53-4f93-8b0d-bfbffe8941ca") : secret "keda-admission-webhooks-certs" not found
Jul 08 16:42:11.970029 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:11.970003    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf6pz\" (UniqueName: \"kubernetes.io/projected/b82381b1-ac53-4f93-8b0d-bfbffe8941ca-kube-api-access-hf6pz\") pod \"keda-admission-5fbd5c4644-9ns26\" (UID: \"b82381b1-ac53-4f93-8b0d-bfbffe8941ca\") " pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:12.467190 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:12.467159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b82381b1-ac53-4f93-8b0d-bfbffe8941ca-certificates\") pod \"keda-admission-5fbd5c4644-9ns26\" (UID: \"b82381b1-ac53-4f93-8b0d-bfbffe8941ca\") " pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:12.469614 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:12.469584    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b82381b1-ac53-4f93-8b0d-bfbffe8941ca-certificates\") pod \"keda-admission-5fbd5c4644-9ns26\" (UID: \"b82381b1-ac53-4f93-8b0d-bfbffe8941ca\") " pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:12.695831 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:12.695800    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:12.828301 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:12.828280    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-9ns26"]
Jul 08 16:42:12.831078 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:42:12.831054    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82381b1_ac53_4f93_8b0d_bfbffe8941ca.slice/crio-e6240567e107e9cf92c70b2c04326c1e3bef5f573b4830c4709c29f05852bbd2 WatchSource:0}: Error finding container e6240567e107e9cf92c70b2c04326c1e3bef5f573b4830c4709c29f05852bbd2: Status 404 returned error can't find the container with id e6240567e107e9cf92c70b2c04326c1e3bef5f573b4830c4709c29f05852bbd2
Jul 08 16:42:13.838294 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:13.838242    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-9ns26" event={"ID":"b82381b1-ac53-4f93-8b0d-bfbffe8941ca","Type":"ContainerStarted","Data":"e6240567e107e9cf92c70b2c04326c1e3bef5f573b4830c4709c29f05852bbd2"}
Jul 08 16:42:14.842795 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:14.842761    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-9ns26" event={"ID":"b82381b1-ac53-4f93-8b0d-bfbffe8941ca","Type":"ContainerStarted","Data":"12a5b9b9670a6a5ec8df63cb66427577334f022b5905a00008428c1e27aa8e25"}
Jul 08 16:42:14.843204 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:14.842866    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:42:14.864904 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:14.864847    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-9ns26" podStartSLOduration=2.502754766 podStartE2EDuration="3.864829105s" totalImagesPullingTime="1.362074339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:42:14.863811279 +0000 UTC m=+492.408164443" watchObservedRunningTime="2026-07-08 16:42:14.864829105 +0000 UTC m=+492.409182255"
Jul 08 16:42:31.831690 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:31.831658    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ltn5n"
Jul 08 16:42:35.849502 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:42:35.849472    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-9ns26"
Jul 08 16:43:20.592073 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.592042    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-rgslh"]
Jul 08 16:43:20.595075 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.595060    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:43:20.597798 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.597775    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 08 16:43:20.598313 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.598296    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 08 16:43:20.598905 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.598886    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-sfzv2\""
Jul 08 16:43:20.599712 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.599693    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 08 16:43:20.608741 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.608720    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-rgslh"]
Jul 08 16:43:20.662286 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.662244    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3af74196-8d7a-44bd-b648-6d5e12f5a5a4-cert\") pod \"llmisvc-controller-manager-84fc959947-rgslh\" (UID: \"3af74196-8d7a-44bd-b648-6d5e12f5a5a4\") " pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:43:20.662438 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.662367    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fscs\" (UniqueName: \"kubernetes.io/projected/3af74196-8d7a-44bd-b648-6d5e12f5a5a4-kube-api-access-4fscs\") pod \"llmisvc-controller-manager-84fc959947-rgslh\" (UID: \"3af74196-8d7a-44bd-b648-6d5e12f5a5a4\") " pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:43:20.762872 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.762834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fscs\" (UniqueName: \"kubernetes.io/projected/3af74196-8d7a-44bd-b648-6d5e12f5a5a4-kube-api-access-4fscs\") pod \"llmisvc-controller-manager-84fc959947-rgslh\" (UID: \"3af74196-8d7a-44bd-b648-6d5e12f5a5a4\") " pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:43:20.763034 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.762921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3af74196-8d7a-44bd-b648-6d5e12f5a5a4-cert\") pod \"llmisvc-controller-manager-84fc959947-rgslh\" (UID: \"3af74196-8d7a-44bd-b648-6d5e12f5a5a4\") " pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:43:20.765561 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.765534    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3af74196-8d7a-44bd-b648-6d5e12f5a5a4-cert\") pod \"llmisvc-controller-manager-84fc959947-rgslh\" (UID: \"3af74196-8d7a-44bd-b648-6d5e12f5a5a4\") " pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:43:20.774668 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.774646    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fscs\" (UniqueName: \"kubernetes.io/projected/3af74196-8d7a-44bd-b648-6d5e12f5a5a4-kube-api-access-4fscs\") pod \"llmisvc-controller-manager-84fc959947-rgslh\" (UID: \"3af74196-8d7a-44bd-b648-6d5e12f5a5a4\") " pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:43:20.906547 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:20.906470    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:43:21.037274 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:21.037235    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-rgslh"]
Jul 08 16:43:21.039331 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:43:21.039302    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3af74196_8d7a_44bd_b648_6d5e12f5a5a4.slice/crio-62a5e5f158d25f9d0eaab6764eccbad12ccb4bcebcb1a2497e93ea13d056072a WatchSource:0}: Error finding container 62a5e5f158d25f9d0eaab6764eccbad12ccb4bcebcb1a2497e93ea13d056072a: Status 404 returned error can't find the container with id 62a5e5f158d25f9d0eaab6764eccbad12ccb4bcebcb1a2497e93ea13d056072a
Jul 08 16:43:21.070374 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:21.070331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-rgslh" event={"ID":"3af74196-8d7a-44bd-b648-6d5e12f5a5a4","Type":"ContainerStarted","Data":"62a5e5f158d25f9d0eaab6764eccbad12ccb4bcebcb1a2497e93ea13d056072a"}
Jul 08 16:43:24.082491 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:24.082446    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-rgslh" event={"ID":"3af74196-8d7a-44bd-b648-6d5e12f5a5a4","Type":"ContainerStarted","Data":"5511754eaac5c1f9ee2ff739e0ae2dc655b0adfdad0e0c773aae0a1b9361dd08"}
Jul 08 16:43:24.082913 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:24.082574    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:43:24.100486 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:24.100375    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84fc959947-rgslh" podStartSLOduration=1.291050942 podStartE2EDuration="4.100355739s" totalImagesPullingTime="2.809304797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:43:24.099532426 +0000 UTC m=+561.643885568" watchObservedRunningTime="2026-07-08 16:43:24.100355739 +0000 UTC m=+561.644708887"
Jul 08 16:43:55.088271 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:43:55.088238    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84fc959947-rgslh"
Jul 08 16:44:02.911812 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:44:02.911785    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:44:02.913367 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:44:02.913345    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:44:02.916682 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:44:02.916665    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:44:02.918019 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:44:02.918004    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:47:37.796181 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:37.796146    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"]
Jul 08 16:47:37.799217 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:37.799201    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:37.801855 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:37.801832    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-f6c4d-serving-cert\""
Jul 08 16:47:37.801986 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:37.801891    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-f6c4d-kube-rbac-proxy-sar-config\""
Jul 08 16:47:37.802840 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:37.802823    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-gs76g\""
Jul 08 16:47:37.802909 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:37.802824    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 16:47:37.807002 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:37.806975    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"]
Jul 08 16:47:37.955408 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:37.955378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac9e3c73-6555-4e6a-98a8-15228438e5f3-openshift-service-ca-bundle\") pod \"switch-graph-f6c4d-6dfbf84d47-nk85s\" (UID: \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\") " pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:37.955611 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:37.955430    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac9e3c73-6555-4e6a-98a8-15228438e5f3-proxy-tls\") pod \"switch-graph-f6c4d-6dfbf84d47-nk85s\" (UID: \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\") " pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:38.056255 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:38.056158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac9e3c73-6555-4e6a-98a8-15228438e5f3-openshift-service-ca-bundle\") pod \"switch-graph-f6c4d-6dfbf84d47-nk85s\" (UID: \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\") " pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:38.056255 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:38.056214    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac9e3c73-6555-4e6a-98a8-15228438e5f3-proxy-tls\") pod \"switch-graph-f6c4d-6dfbf84d47-nk85s\" (UID: \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\") " pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:38.056861 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:38.056841    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac9e3c73-6555-4e6a-98a8-15228438e5f3-openshift-service-ca-bundle\") pod \"switch-graph-f6c4d-6dfbf84d47-nk85s\" (UID: \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\") " pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:38.058639 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:38.058622    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac9e3c73-6555-4e6a-98a8-15228438e5f3-proxy-tls\") pod \"switch-graph-f6c4d-6dfbf84d47-nk85s\" (UID: \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\") " pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:38.110211 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:38.110185    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:38.237482 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:38.237435    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"]
Jul 08 16:47:38.239758 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:47:38.239733    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9e3c73_6555_4e6a_98a8_15228438e5f3.slice/crio-afa6b4bc8569b086e2e13a2274f2e4088b7d530cff6f1b992e8c31ab42701a48 WatchSource:0}: Error finding container afa6b4bc8569b086e2e13a2274f2e4088b7d530cff6f1b992e8c31ab42701a48: Status 404 returned error can't find the container with id afa6b4bc8569b086e2e13a2274f2e4088b7d530cff6f1b992e8c31ab42701a48
Jul 08 16:47:38.241578 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:38.241560    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:47:39.005975 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:39.005938    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" event={"ID":"ac9e3c73-6555-4e6a-98a8-15228438e5f3","Type":"ContainerStarted","Data":"afa6b4bc8569b086e2e13a2274f2e4088b7d530cff6f1b992e8c31ab42701a48"}
Jul 08 16:47:41.014985 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:41.014947    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" event={"ID":"ac9e3c73-6555-4e6a-98a8-15228438e5f3","Type":"ContainerStarted","Data":"cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591"}
Jul 08 16:47:41.015435 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:41.015078    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:41.042130 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:41.042067    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" podStartSLOduration=1.432300153 podStartE2EDuration="4.042053166s" totalImagesPullingTime="2.609753013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:47:41.040396729 +0000 UTC m=+818.584749878" watchObservedRunningTime="2026-07-08 16:47:41.042053166 +0000 UTC m=+818.586406314"
Jul 08 16:47:47.024276 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:47.024250    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:47:47.966182 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:47.966149    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"]
Jul 08 16:47:47.966482 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:47.966438    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d" containerID="cri-o://cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591" gracePeriod=30
Jul 08 16:47:52.022932 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:52.022884    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:47:57.022910 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:47:57.022869    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:48:02.023228 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:02.023180    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:48:02.023742 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:02.023296    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:48:07.022676 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:07.022637    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:48:12.022986 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:12.022951    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:48:17.022493 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:17.022432    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:48:18.108501 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.108470    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:48:18.139533 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.139497    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac9e3c73-6555-4e6a-98a8-15228438e5f3-openshift-service-ca-bundle\") pod \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\" (UID: \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\") "
Jul 08 16:48:18.139693 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.139578    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac9e3c73-6555-4e6a-98a8-15228438e5f3-proxy-tls\") pod \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\" (UID: \"ac9e3c73-6555-4e6a-98a8-15228438e5f3\") "
Jul 08 16:48:18.139857 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.139832    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac9e3c73-6555-4e6a-98a8-15228438e5f3-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ac9e3c73-6555-4e6a-98a8-15228438e5f3" (UID: "ac9e3c73-6555-4e6a-98a8-15228438e5f3"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:48:18.141875 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.141855    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac9e3c73-6555-4e6a-98a8-15228438e5f3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ac9e3c73-6555-4e6a-98a8-15228438e5f3" (UID: "ac9e3c73-6555-4e6a-98a8-15228438e5f3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:48:18.148994 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.148970    2583 generic.go:356] "Generic (PLEG): container finished" podID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerID="cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591" exitCode=0
Jul 08 16:48:18.149095 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.149009    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" event={"ID":"ac9e3c73-6555-4e6a-98a8-15228438e5f3","Type":"ContainerDied","Data":"cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591"}
Jul 08 16:48:18.149095 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.149012    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"
Jul 08 16:48:18.149095 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.149076    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s" event={"ID":"ac9e3c73-6555-4e6a-98a8-15228438e5f3","Type":"ContainerDied","Data":"afa6b4bc8569b086e2e13a2274f2e4088b7d530cff6f1b992e8c31ab42701a48"}
Jul 08 16:48:18.149212 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.149097    2583 scope.go:117] "RemoveContainer" containerID="cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591"
Jul 08 16:48:18.157881 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.157837    2583 scope.go:117] "RemoveContainer" containerID="cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591"
Jul 08 16:48:18.161784 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:48:18.161761    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591\": container with ID starting with cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591 not found: ID does not exist" containerID="cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591"
Jul 08 16:48:18.161896 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.161797    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591"} err="failed to get container status \"cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591\": rpc error: code = NotFound desc = could not find container \"cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591\": container with ID starting with cfefbf270827b07b0f510b4f5f7ce2dceaa4b649941d3959e001d1c25c835591 not found: ID does not exist"
Jul 08 16:48:18.169936 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.169914    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"]
Jul 08 16:48:18.179346 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.179325    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f6c4d-6dfbf84d47-nk85s"]
Jul 08 16:48:18.241042 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.240963    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac9e3c73-6555-4e6a-98a8-15228438e5f3-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:48:18.241042 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:18.240993    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac9e3c73-6555-4e6a-98a8-15228438e5f3-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:48:19.004882 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:19.004851    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" path="/var/lib/kubelet/pods/ac9e3c73-6555-4e6a-98a8-15228438e5f3/volumes"
Jul 08 16:48:37.795143 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.795112    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"]
Jul 08 16:48:37.795645 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.795374    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d"
Jul 08 16:48:37.795645 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.795384    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d"
Jul 08 16:48:37.795645 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.795436    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac9e3c73-6555-4e6a-98a8-15228438e5f3" containerName="switch-graph-f6c4d"
Jul 08 16:48:37.798247 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.798233    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:37.801040 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.801016    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 08 16:48:37.801168 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.801074    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 16:48:37.801168 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.801091    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 08 16:48:37.802270 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.802252    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-gs76g\""
Jul 08 16:48:37.807697 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.807679    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"]
Jul 08 16:48:37.885006 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.884962    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e72dfb-990c-402c-bc90-8a94b59ec1f1-openshift-service-ca-bundle\") pod \"model-chainer-658ff57b89-v7pjz\" (UID: \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\") " pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:37.885174 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.885079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66e72dfb-990c-402c-bc90-8a94b59ec1f1-proxy-tls\") pod \"model-chainer-658ff57b89-v7pjz\" (UID: \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\") " pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:37.985742 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.985710    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66e72dfb-990c-402c-bc90-8a94b59ec1f1-proxy-tls\") pod \"model-chainer-658ff57b89-v7pjz\" (UID: \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\") " pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:37.985957 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.985754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e72dfb-990c-402c-bc90-8a94b59ec1f1-openshift-service-ca-bundle\") pod \"model-chainer-658ff57b89-v7pjz\" (UID: \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\") " pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:37.985957 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:48:37.985889    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found
Jul 08 16:48:37.986069 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:48:37.985979    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e72dfb-990c-402c-bc90-8a94b59ec1f1-proxy-tls podName:66e72dfb-990c-402c-bc90-8a94b59ec1f1 nodeName:}" failed. No retries permitted until 2026-07-08 16:48:38.485957905 +0000 UTC m=+876.030311039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/66e72dfb-990c-402c-bc90-8a94b59ec1f1-proxy-tls") pod "model-chainer-658ff57b89-v7pjz" (UID: "66e72dfb-990c-402c-bc90-8a94b59ec1f1") : secret "model-chainer-serving-cert" not found
Jul 08 16:48:37.986362 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:37.986342    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e72dfb-990c-402c-bc90-8a94b59ec1f1-openshift-service-ca-bundle\") pod \"model-chainer-658ff57b89-v7pjz\" (UID: \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\") " pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:38.489814 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:38.489761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66e72dfb-990c-402c-bc90-8a94b59ec1f1-proxy-tls\") pod \"model-chainer-658ff57b89-v7pjz\" (UID: \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\") " pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:38.492274 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:38.492243    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66e72dfb-990c-402c-bc90-8a94b59ec1f1-proxy-tls\") pod \"model-chainer-658ff57b89-v7pjz\" (UID: \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\") " pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:38.708908 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:38.708870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:38.837197 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:38.837176    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"]
Jul 08 16:48:38.839436 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:48:38.839402    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e72dfb_990c_402c_bc90_8a94b59ec1f1.slice/crio-d58f34bfc8d5c4b95dbf2d71697a72de9f5f9da96e2d8012638df7a36fbff187 WatchSource:0}: Error finding container d58f34bfc8d5c4b95dbf2d71697a72de9f5f9da96e2d8012638df7a36fbff187: Status 404 returned error can't find the container with id d58f34bfc8d5c4b95dbf2d71697a72de9f5f9da96e2d8012638df7a36fbff187
Jul 08 16:48:39.230508 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:39.230443    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" event={"ID":"66e72dfb-990c-402c-bc90-8a94b59ec1f1","Type":"ContainerStarted","Data":"8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345"}
Jul 08 16:48:39.230700 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:39.230547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" event={"ID":"66e72dfb-990c-402c-bc90-8a94b59ec1f1","Type":"ContainerStarted","Data":"d58f34bfc8d5c4b95dbf2d71697a72de9f5f9da96e2d8012638df7a36fbff187"}
Jul 08 16:48:39.230700 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:39.230580    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:39.246447 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:39.246400    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" podStartSLOduration=2.246385251 podStartE2EDuration="2.246385251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:48:39.245512007 +0000 UTC m=+876.789865156" watchObservedRunningTime="2026-07-08 16:48:39.246385251 +0000 UTC m=+876.790738399"
Jul 08 16:48:45.241084 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:45.241053    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:48:47.894429 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:47.894399    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"]
Jul 08 16:48:47.894912 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:47.894586    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer" containerID="cri-o://8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345" gracePeriod=30
Jul 08 16:48:48.221391 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.221358    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"]
Jul 08 16:48:48.224617 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.224601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:48:48.227108 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.227083    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-429af-serving-cert\""
Jul 08 16:48:48.227208 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.227085    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-429af-kube-rbac-proxy-sar-config\""
Jul 08 16:48:48.244801 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.244773    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"]
Jul 08 16:48:48.263755 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.263726    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce16306-c24a-4aba-a662-fa67268316b4-openshift-service-ca-bundle\") pod \"switch-graph-429af-6d6c9b7b59-jzl22\" (UID: \"8ce16306-c24a-4aba-a662-fa67268316b4\") " pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:48:48.263905 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.263773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce16306-c24a-4aba-a662-fa67268316b4-proxy-tls\") pod \"switch-graph-429af-6d6c9b7b59-jzl22\" (UID: \"8ce16306-c24a-4aba-a662-fa67268316b4\") " pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:48:48.364924 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.364887    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce16306-c24a-4aba-a662-fa67268316b4-openshift-service-ca-bundle\") pod \"switch-graph-429af-6d6c9b7b59-jzl22\" (UID: \"8ce16306-c24a-4aba-a662-fa67268316b4\") " pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:48:48.365089 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.364940    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce16306-c24a-4aba-a662-fa67268316b4-proxy-tls\") pod \"switch-graph-429af-6d6c9b7b59-jzl22\" (UID: \"8ce16306-c24a-4aba-a662-fa67268316b4\") " pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:48:48.365656 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.365626    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce16306-c24a-4aba-a662-fa67268316b4-openshift-service-ca-bundle\") pod \"switch-graph-429af-6d6c9b7b59-jzl22\" (UID: \"8ce16306-c24a-4aba-a662-fa67268316b4\") " pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:48:48.367447 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.367421    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce16306-c24a-4aba-a662-fa67268316b4-proxy-tls\") pod \"switch-graph-429af-6d6c9b7b59-jzl22\" (UID: \"8ce16306-c24a-4aba-a662-fa67268316b4\") " pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:48:48.561185 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.561088    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:48:48.685256 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:48.685230    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"]
Jul 08 16:48:48.687659 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:48:48.687629    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce16306_c24a_4aba_a662_fa67268316b4.slice/crio-752e29d9c87167ee91eebd3d9f2dbbdb144da875e7a3daa562e5e012cc11367a WatchSource:0}: Error finding container 752e29d9c87167ee91eebd3d9f2dbbdb144da875e7a3daa562e5e012cc11367a: Status 404 returned error can't find the container with id 752e29d9c87167ee91eebd3d9f2dbbdb144da875e7a3daa562e5e012cc11367a
Jul 08 16:48:49.269756 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:49.269720    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" event={"ID":"8ce16306-c24a-4aba-a662-fa67268316b4","Type":"ContainerStarted","Data":"f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7"}
Jul 08 16:48:49.270158 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:49.269781    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" event={"ID":"8ce16306-c24a-4aba-a662-fa67268316b4","Type":"ContainerStarted","Data":"752e29d9c87167ee91eebd3d9f2dbbdb144da875e7a3daa562e5e012cc11367a"}
Jul 08 16:48:49.270158 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:49.269820    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:48:49.286554 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:49.286508    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" podStartSLOduration=1.286492539 podStartE2EDuration="1.286492539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:48:49.286209459 +0000 UTC m=+886.830562607" watchObservedRunningTime="2026-07-08 16:48:49.286492539 +0000 UTC m=+886.830845688"
Jul 08 16:48:50.239391 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:50.239351    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:48:55.239038 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:55.238942    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:48:55.279409 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:48:55.279386    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:49:00.239318 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:00.239281    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:49:00.239738 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:00.239377    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:49:02.935631 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:02.935607    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:49:02.936052 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:02.935607    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:49:02.940490 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:02.940466    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:49:02.940651 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:02.940595    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:49:05.239487 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:05.239432    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:49:10.238867 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:10.238813    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:49:15.238827 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:15.238792    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:49:18.035158 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.035134    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:49:18.195907 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.195880    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e72dfb-990c-402c-bc90-8a94b59ec1f1-openshift-service-ca-bundle\") pod \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\" (UID: \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\") "
Jul 08 16:49:18.196060 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.195922    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66e72dfb-990c-402c-bc90-8a94b59ec1f1-proxy-tls\") pod \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\" (UID: \"66e72dfb-990c-402c-bc90-8a94b59ec1f1\") "
Jul 08 16:49:18.196209 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.196186    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e72dfb-990c-402c-bc90-8a94b59ec1f1-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "66e72dfb-990c-402c-bc90-8a94b59ec1f1" (UID: "66e72dfb-990c-402c-bc90-8a94b59ec1f1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:49:18.198001 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.197975    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e72dfb-990c-402c-bc90-8a94b59ec1f1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "66e72dfb-990c-402c-bc90-8a94b59ec1f1" (UID: "66e72dfb-990c-402c-bc90-8a94b59ec1f1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:49:18.297164 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.297139    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66e72dfb-990c-402c-bc90-8a94b59ec1f1-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:49:18.297164 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.297164    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66e72dfb-990c-402c-bc90-8a94b59ec1f1-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:49:18.381039 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.381005    2583 generic.go:356] "Generic (PLEG): container finished" podID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerID="8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345" exitCode=0
Jul 08 16:49:18.381197 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.381047    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" event={"ID":"66e72dfb-990c-402c-bc90-8a94b59ec1f1","Type":"ContainerDied","Data":"8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345"}
Jul 08 16:49:18.381197 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.381086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz" event={"ID":"66e72dfb-990c-402c-bc90-8a94b59ec1f1","Type":"ContainerDied","Data":"d58f34bfc8d5c4b95dbf2d71697a72de9f5f9da96e2d8012638df7a36fbff187"}
Jul 08 16:49:18.381197 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.381111    2583 scope.go:117] "RemoveContainer" containerID="8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345"
Jul 08 16:49:18.381197 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.381048    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"
Jul 08 16:49:18.392130 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.392108    2583 scope.go:117] "RemoveContainer" containerID="8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345"
Jul 08 16:49:18.392478 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:49:18.392439    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345\": container with ID starting with 8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345 not found: ID does not exist" containerID="8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345"
Jul 08 16:49:18.392541 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.392490    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345"} err="failed to get container status \"8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345\": rpc error: code = NotFound desc = could not find container \"8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345\": container with ID starting with 8de2005024a2499de442f8bdc1458ca217709d765ce60d2d3ba6657aa211a345 not found: ID does not exist"
Jul 08 16:49:18.403392 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.403371    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"]
Jul 08 16:49:18.406651 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:18.406632    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-658ff57b89-v7pjz"]
Jul 08 16:49:19.005341 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:19.005307    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" path="/var/lib/kubelet/pods/66e72dfb-990c-402c-bc90-8a94b59ec1f1/volumes"
Jul 08 16:49:48.119233 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.119198    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"]
Jul 08 16:49:48.119708 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.119488    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer"
Jul 08 16:49:48.119708 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.119504    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer"
Jul 08 16:49:48.119708 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.119561    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e72dfb-990c-402c-bc90-8a94b59ec1f1" containerName="model-chainer"
Jul 08 16:49:48.122440 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.122424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:49:48.124872 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.124846    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-fcbfa-serving-cert\""
Jul 08 16:49:48.125006 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.124899    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-fcbfa-kube-rbac-proxy-sar-config\""
Jul 08 16:49:48.131924 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.131899    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"]
Jul 08 16:49:48.224688 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.224650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b549a-c385-40b3-8291-0bba0c89ebfd-proxy-tls\") pod \"sequence-graph-fcbfa-6dfb4df4f4-47wtl\" (UID: \"a51b549a-c385-40b3-8291-0bba0c89ebfd\") " pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:49:48.224868 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.224705    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51b549a-c385-40b3-8291-0bba0c89ebfd-openshift-service-ca-bundle\") pod \"sequence-graph-fcbfa-6dfb4df4f4-47wtl\" (UID: \"a51b549a-c385-40b3-8291-0bba0c89ebfd\") " pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:49:48.325189 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.325157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51b549a-c385-40b3-8291-0bba0c89ebfd-openshift-service-ca-bundle\") pod \"sequence-graph-fcbfa-6dfb4df4f4-47wtl\" (UID: \"a51b549a-c385-40b3-8291-0bba0c89ebfd\") " pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:49:48.325351 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.325215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b549a-c385-40b3-8291-0bba0c89ebfd-proxy-tls\") pod \"sequence-graph-fcbfa-6dfb4df4f4-47wtl\" (UID: \"a51b549a-c385-40b3-8291-0bba0c89ebfd\") " pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:49:48.325888 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.325823    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51b549a-c385-40b3-8291-0bba0c89ebfd-openshift-service-ca-bundle\") pod \"sequence-graph-fcbfa-6dfb4df4f4-47wtl\" (UID: \"a51b549a-c385-40b3-8291-0bba0c89ebfd\") " pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:49:48.327642 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.327621    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b549a-c385-40b3-8291-0bba0c89ebfd-proxy-tls\") pod \"sequence-graph-fcbfa-6dfb4df4f4-47wtl\" (UID: \"a51b549a-c385-40b3-8291-0bba0c89ebfd\") " pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:49:48.433647 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.433620    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:49:48.561498 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:48.561446    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"]
Jul 08 16:49:48.564986 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:49:48.564951    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51b549a_c385_40b3_8291_0bba0c89ebfd.slice/crio-fdcb60d7fc7cb20f9596277fc37065af1d8f94366f5981930de1d44a15231492 WatchSource:0}: Error finding container fdcb60d7fc7cb20f9596277fc37065af1d8f94366f5981930de1d44a15231492: Status 404 returned error can't find the container with id fdcb60d7fc7cb20f9596277fc37065af1d8f94366f5981930de1d44a15231492
Jul 08 16:49:49.504314 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:49.504282    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" event={"ID":"a51b549a-c385-40b3-8291-0bba0c89ebfd","Type":"ContainerStarted","Data":"48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979"}
Jul 08 16:49:49.504718 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:49.504332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" event={"ID":"a51b549a-c385-40b3-8291-0bba0c89ebfd","Type":"ContainerStarted","Data":"fdcb60d7fc7cb20f9596277fc37065af1d8f94366f5981930de1d44a15231492"}
Jul 08 16:49:49.504718 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:49.504401    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:49:49.525398 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:49.525347    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" podStartSLOduration=1.525325532 podStartE2EDuration="1.525325532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:49:49.523968339 +0000 UTC m=+947.068321492" watchObservedRunningTime="2026-07-08 16:49:49.525325532 +0000 UTC m=+947.069678711"
Jul 08 16:49:55.512863 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:49:55.512825    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:54:02.957800 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:54:02.957769    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:54:02.959116 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:54:02.959098    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:54:02.962982 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:54:02.962962    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:54:02.964218 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:54:02.964196    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:57:02.918388 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:02.918355    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"]
Jul 08 16:57:02.920930 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:02.918757    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af" containerID="cri-o://f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7" gracePeriod=30
Jul 08 16:57:05.278348 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:05.278311    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:57:10.277847 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:10.277801    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:57:15.278030 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:15.277993    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:57:15.278403 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:15.278099    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:57:20.278592 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:20.278553    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:57:25.277697 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:25.277662    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:57:30.278146 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:30.278104    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:57:33.055953 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.055927    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:57:33.069993 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.069960    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce16306-c24a-4aba-a662-fa67268316b4-proxy-tls\") pod \"8ce16306-c24a-4aba-a662-fa67268316b4\" (UID: \"8ce16306-c24a-4aba-a662-fa67268316b4\") "
Jul 08 16:57:33.070118 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.070023    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce16306-c24a-4aba-a662-fa67268316b4-openshift-service-ca-bundle\") pod \"8ce16306-c24a-4aba-a662-fa67268316b4\" (UID: \"8ce16306-c24a-4aba-a662-fa67268316b4\") "
Jul 08 16:57:33.070388 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.070366    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce16306-c24a-4aba-a662-fa67268316b4-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8ce16306-c24a-4aba-a662-fa67268316b4" (UID: "8ce16306-c24a-4aba-a662-fa67268316b4"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:57:33.072422 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.072386    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce16306-c24a-4aba-a662-fa67268316b4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8ce16306-c24a-4aba-a662-fa67268316b4" (UID: "8ce16306-c24a-4aba-a662-fa67268316b4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:57:33.171111 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.171074    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce16306-c24a-4aba-a662-fa67268316b4-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:57:33.171111 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.171104    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce16306-c24a-4aba-a662-fa67268316b4-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:57:33.305134 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.305105    2583 generic.go:356] "Generic (PLEG): container finished" podID="8ce16306-c24a-4aba-a662-fa67268316b4" containerID="f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7" exitCode=0
Jul 08 16:57:33.305310 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.305151    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"
Jul 08 16:57:33.305310 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.305192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" event={"ID":"8ce16306-c24a-4aba-a662-fa67268316b4","Type":"ContainerDied","Data":"f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7"}
Jul 08 16:57:33.305310 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.305250    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22" event={"ID":"8ce16306-c24a-4aba-a662-fa67268316b4","Type":"ContainerDied","Data":"752e29d9c87167ee91eebd3d9f2dbbdb144da875e7a3daa562e5e012cc11367a"}
Jul 08 16:57:33.305310 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.305280    2583 scope.go:117] "RemoveContainer" containerID="f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7"
Jul 08 16:57:33.313677 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.313659    2583 scope.go:117] "RemoveContainer" containerID="f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7"
Jul 08 16:57:33.313953 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:57:33.313918    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7\": container with ID starting with f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7 not found: ID does not exist" containerID="f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7"
Jul 08 16:57:33.313990 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.313965    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7"} err="failed to get container status \"f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7\": rpc error: code = NotFound desc = could not find container \"f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7\": container with ID starting with f203c4056e7d41d5190d902a36d3fed1ee01c4a3aa1460f663a2913fb12e7eb7 not found: ID does not exist"
Jul 08 16:57:33.326505 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.326479    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"]
Jul 08 16:57:33.332173 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:33.332152    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-429af-6d6c9b7b59-jzl22"]
Jul 08 16:57:35.004662 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:57:35.004631    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" path="/var/lib/kubelet/pods/8ce16306-c24a-4aba-a662-fa67268316b4/volumes"
Jul 08 16:58:02.782030 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:02.781940    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"]
Jul 08 16:58:02.782443 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:02.782185    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa" containerID="cri-o://48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979" gracePeriod=30
Jul 08 16:58:03.191089 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.191059    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"]
Jul 08 16:58:03.191374 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.191361    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af"
Jul 08 16:58:03.191436 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.191376    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af"
Jul 08 16:58:03.191436 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.191432    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce16306-c24a-4aba-a662-fa67268316b4" containerName="switch-graph-429af"
Jul 08 16:58:03.195258 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.195237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:03.198050 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.198022    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-109dc-kube-rbac-proxy-sar-config\""
Jul 08 16:58:03.198329 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.198313    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-109dc-serving-cert\""
Jul 08 16:58:03.207895 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.207870    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"]
Jul 08 16:58:03.309072 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.309034    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-openshift-service-ca-bundle\") pod \"ensemble-graph-109dc-6bb57b867f-prbqj\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") " pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:03.309251 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.309082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls\") pod \"ensemble-graph-109dc-6bb57b867f-prbqj\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") " pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:03.410284 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.410231    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-openshift-service-ca-bundle\") pod \"ensemble-graph-109dc-6bb57b867f-prbqj\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") " pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:03.410284 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.410287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls\") pod \"ensemble-graph-109dc-6bb57b867f-prbqj\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") " pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:03.410542 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:58:03.410425    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-109dc-serving-cert: secret "ensemble-graph-109dc-serving-cert" not found
Jul 08 16:58:03.410542 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:58:03.410520    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls podName:d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1 nodeName:}" failed. No retries permitted until 2026-07-08 16:58:03.910498919 +0000 UTC m=+1441.454852052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls") pod "ensemble-graph-109dc-6bb57b867f-prbqj" (UID: "d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1") : secret "ensemble-graph-109dc-serving-cert" not found
Jul 08 16:58:03.410918 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.410898    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-openshift-service-ca-bundle\") pod \"ensemble-graph-109dc-6bb57b867f-prbqj\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") " pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:03.916256 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:03.916212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls\") pod \"ensemble-graph-109dc-6bb57b867f-prbqj\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") " pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:03.916693 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:58:03.916366    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-109dc-serving-cert: secret "ensemble-graph-109dc-serving-cert" not found
Jul 08 16:58:03.916693 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:58:03.916429    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls podName:d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1 nodeName:}" failed. No retries permitted until 2026-07-08 16:58:04.91641381 +0000 UTC m=+1442.460766938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls") pod "ensemble-graph-109dc-6bb57b867f-prbqj" (UID: "d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1") : secret "ensemble-graph-109dc-serving-cert" not found
Jul 08 16:58:04.925938 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:04.925899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls\") pod \"ensemble-graph-109dc-6bb57b867f-prbqj\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") " pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:04.928545 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:04.928521    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls\") pod \"ensemble-graph-109dc-6bb57b867f-prbqj\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") " pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:05.009004 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:05.008974    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:05.147257 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:05.147226    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"]
Jul 08 16:58:05.150472 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:58:05.150421    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f9b0eb_2a9a_4fd7_8eb9_960e3519caa1.slice/crio-4a05c5ed40262eb2a602fdf1437244166fe520d5b9db7d8c6e6eec687d9e43d1 WatchSource:0}: Error finding container 4a05c5ed40262eb2a602fdf1437244166fe520d5b9db7d8c6e6eec687d9e43d1: Status 404 returned error can't find the container with id 4a05c5ed40262eb2a602fdf1437244166fe520d5b9db7d8c6e6eec687d9e43d1
Jul 08 16:58:05.435261 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:05.435226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" event={"ID":"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1","Type":"ContainerStarted","Data":"dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8"}
Jul 08 16:58:05.435481 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:05.435277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" event={"ID":"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1","Type":"ContainerStarted","Data":"4a05c5ed40262eb2a602fdf1437244166fe520d5b9db7d8c6e6eec687d9e43d1"}
Jul 08 16:58:05.435481 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:05.435340    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:05.453668 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:05.453559    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" podStartSLOduration=2.453541666 podStartE2EDuration="2.453541666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:58:05.452582266 +0000 UTC m=+1442.996935418" watchObservedRunningTime="2026-07-08 16:58:05.453541666 +0000 UTC m=+1442.997894816"
Jul 08 16:58:05.512270 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:05.512232    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:10.512114 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:10.512078    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:11.445104 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:11.445077    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:13.257863 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:13.257835    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"]
Jul 08 16:58:13.258295 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:13.258027    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc" containerID="cri-o://dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8" gracePeriod=30
Jul 08 16:58:15.511777 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:15.511738    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:15.512153 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:15.511860    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:58:16.443027 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:16.442992    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:20.512513 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:20.512477    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:21.442953 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:21.442914    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:25.512489 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:25.512439    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:26.443423 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:26.443376    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:26.443655 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:26.443518    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:30.512998 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:30.512960    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:31.443500 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:31.443435    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:32.932005 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:32.931980    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:58:33.046143 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.046055    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51b549a-c385-40b3-8291-0bba0c89ebfd-openshift-service-ca-bundle\") pod \"a51b549a-c385-40b3-8291-0bba0c89ebfd\" (UID: \"a51b549a-c385-40b3-8291-0bba0c89ebfd\") "
Jul 08 16:58:33.046143 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.046096    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b549a-c385-40b3-8291-0bba0c89ebfd-proxy-tls\") pod \"a51b549a-c385-40b3-8291-0bba0c89ebfd\" (UID: \"a51b549a-c385-40b3-8291-0bba0c89ebfd\") "
Jul 08 16:58:33.046394 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.046369    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51b549a-c385-40b3-8291-0bba0c89ebfd-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a51b549a-c385-40b3-8291-0bba0c89ebfd" (UID: "a51b549a-c385-40b3-8291-0bba0c89ebfd"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:58:33.048324 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.048298    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a51b549a-c385-40b3-8291-0bba0c89ebfd-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a51b549a-c385-40b3-8291-0bba0c89ebfd" (UID: "a51b549a-c385-40b3-8291-0bba0c89ebfd"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:58:33.146972 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.146936    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51b549a-c385-40b3-8291-0bba0c89ebfd-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:58:33.146972 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.146965    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b549a-c385-40b3-8291-0bba0c89ebfd-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:58:33.546872 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.546840    2583 generic.go:356] "Generic (PLEG): container finished" podID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerID="48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979" exitCode=0
Jul 08 16:58:33.547039 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.546890    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"
Jul 08 16:58:33.547039 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.546925    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" event={"ID":"a51b549a-c385-40b3-8291-0bba0c89ebfd","Type":"ContainerDied","Data":"48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979"}
Jul 08 16:58:33.547039 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.546982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl" event={"ID":"a51b549a-c385-40b3-8291-0bba0c89ebfd","Type":"ContainerDied","Data":"fdcb60d7fc7cb20f9596277fc37065af1d8f94366f5981930de1d44a15231492"}
Jul 08 16:58:33.547039 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.547009    2583 scope.go:117] "RemoveContainer" containerID="48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979"
Jul 08 16:58:33.555392 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.555375    2583 scope.go:117] "RemoveContainer" containerID="48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979"
Jul 08 16:58:33.555684 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:58:33.555664    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979\": container with ID starting with 48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979 not found: ID does not exist" containerID="48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979"
Jul 08 16:58:33.555743 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.555692    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979"} err="failed to get container status \"48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979\": rpc error: code = NotFound desc = could not find container \"48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979\": container with ID starting with 48f1874af3e23fcb7c567f2b2d2c200fbaa832fc3e0e1410ab74b5424f195979 not found: ID does not exist"
Jul 08 16:58:33.567659 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.567631    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"]
Jul 08 16:58:33.571437 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:33.571418    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-fcbfa-6dfb4df4f4-47wtl"]
Jul 08 16:58:35.005404 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:35.005358    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" path="/var/lib/kubelet/pods/a51b549a-c385-40b3-8291-0bba0c89ebfd/volumes"
Jul 08 16:58:36.443529 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:36.443483    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:41.442869 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:41.442813    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:58:43.405117 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.405091    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:43.417155 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.417135    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-openshift-service-ca-bundle\") pod \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") "
Jul 08 16:58:43.417240 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.417169    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls\") pod \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\" (UID: \"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1\") "
Jul 08 16:58:43.417612 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.417589    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" (UID: "d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:58:43.419352 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.419326    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" (UID: "d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:58:43.518608 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.518527    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:58:43.518608 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.518555    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:58:43.591641 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.591606    2583 generic.go:356] "Generic (PLEG): container finished" podID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerID="dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8" exitCode=0
Jul 08 16:58:43.591828 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.591661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" event={"ID":"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1","Type":"ContainerDied","Data":"dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8"}
Jul 08 16:58:43.591828 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.591708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj" event={"ID":"d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1","Type":"ContainerDied","Data":"4a05c5ed40262eb2a602fdf1437244166fe520d5b9db7d8c6e6eec687d9e43d1"}
Jul 08 16:58:43.591828 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.591736    2583 scope.go:117] "RemoveContainer" containerID="dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8"
Jul 08 16:58:43.591828 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.591666    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"
Jul 08 16:58:43.600129 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.600109    2583 scope.go:117] "RemoveContainer" containerID="dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8"
Jul 08 16:58:43.600400 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:58:43.600382    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8\": container with ID starting with dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8 not found: ID does not exist" containerID="dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8"
Jul 08 16:58:43.600473 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.600409    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8"} err="failed to get container status \"dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8\": rpc error: code = NotFound desc = could not find container \"dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8\": container with ID starting with dee604880a7386c1511034fbaa240d00265884b5723870fc7d3de36564898eb8 not found: ID does not exist"
Jul 08 16:58:43.614076 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.614053    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"]
Jul 08 16:58:43.619569 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:43.619544    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-109dc-6bb57b867f-prbqj"]
Jul 08 16:58:45.005141 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:58:45.005107    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" path="/var/lib/kubelet/pods/d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1/volumes"
Jul 08 16:59:02.980145 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:02.980114    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:59:02.981626 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:02.981607    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 16:59:02.985723 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:02.985699    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:59:02.987380 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:02.987362    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 16:59:02.999853 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:02.999829    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"]
Jul 08 16:59:03.000243 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.000227    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc"
Jul 08 16:59:03.000284 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.000247    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc"
Jul 08 16:59:03.000284 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.000269    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa"
Jul 08 16:59:03.000284 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.000279    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa"
Jul 08 16:59:03.000391 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.000359    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f9b0eb-2a9a-4fd7-8eb9-960e3519caa1" containerName="ensemble-graph-109dc"
Jul 08 16:59:03.000391 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.000371    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a51b549a-c385-40b3-8291-0bba0c89ebfd" containerName="sequence-graph-fcbfa"
Jul 08 16:59:03.003244 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.003221    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:03.005915 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.005891    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-178bc-serving-cert\""
Jul 08 16:59:03.005915 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.005909    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-gs76g\""
Jul 08 16:59:03.006108 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.005892    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-178bc-kube-rbac-proxy-sar-config\""
Jul 08 16:59:03.006108 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.005896    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 16:59:03.014305 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.014282    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"]
Jul 08 16:59:03.059099 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.059071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44269f71-20e0-4978-8a33-1ba022775385-proxy-tls\") pod \"sequence-graph-178bc-84fb875cf-fkbbh\" (UID: \"44269f71-20e0-4978-8a33-1ba022775385\") " pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:03.059239 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.059130    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44269f71-20e0-4978-8a33-1ba022775385-openshift-service-ca-bundle\") pod \"sequence-graph-178bc-84fb875cf-fkbbh\" (UID: \"44269f71-20e0-4978-8a33-1ba022775385\") " pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:03.159665 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.159627    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44269f71-20e0-4978-8a33-1ba022775385-openshift-service-ca-bundle\") pod \"sequence-graph-178bc-84fb875cf-fkbbh\" (UID: \"44269f71-20e0-4978-8a33-1ba022775385\") " pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:03.159844 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.159687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44269f71-20e0-4978-8a33-1ba022775385-proxy-tls\") pod \"sequence-graph-178bc-84fb875cf-fkbbh\" (UID: \"44269f71-20e0-4978-8a33-1ba022775385\") " pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:03.160255 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.160237    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44269f71-20e0-4978-8a33-1ba022775385-openshift-service-ca-bundle\") pod \"sequence-graph-178bc-84fb875cf-fkbbh\" (UID: \"44269f71-20e0-4978-8a33-1ba022775385\") " pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:03.162322 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.162303    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44269f71-20e0-4978-8a33-1ba022775385-proxy-tls\") pod \"sequence-graph-178bc-84fb875cf-fkbbh\" (UID: \"44269f71-20e0-4978-8a33-1ba022775385\") " pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:03.314776 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.314686    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:03.452791 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.452766    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"]
Jul 08 16:59:03.455343 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:59:03.455306    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44269f71_20e0_4978_8a33_1ba022775385.slice/crio-f7104c096b157091d27d4ac0503219f170af0f9f25d9ca5c481727c882b72f73 WatchSource:0}: Error finding container f7104c096b157091d27d4ac0503219f170af0f9f25d9ca5c481727c882b72f73: Status 404 returned error can't find the container with id f7104c096b157091d27d4ac0503219f170af0f9f25d9ca5c481727c882b72f73
Jul 08 16:59:03.672607 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.672522    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" event={"ID":"44269f71-20e0-4978-8a33-1ba022775385","Type":"ContainerStarted","Data":"4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc"}
Jul 08 16:59:03.672607 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.672572    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" event={"ID":"44269f71-20e0-4978-8a33-1ba022775385","Type":"ContainerStarted","Data":"f7104c096b157091d27d4ac0503219f170af0f9f25d9ca5c481727c882b72f73"}
Jul 08 16:59:03.672791 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:03.672629    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:09.682995 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:09.682966    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:09.703771 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:09.703696    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" podStartSLOduration=7.703680569 podStartE2EDuration="7.703680569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:59:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:59:03.693046189 +0000 UTC m=+1501.237399339" watchObservedRunningTime="2026-07-08 16:59:09.703680569 +0000 UTC m=+1507.248033719"
Jul 08 16:59:13.074767 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.074740    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"]
Jul 08 16:59:13.075171 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.074931    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc" containerID="cri-o://4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc" gracePeriod=30
Jul 08 16:59:13.510580 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.510543    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"]
Jul 08 16:59:13.513869 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.513846    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:13.517612 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.517587    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-806a8-kube-rbac-proxy-sar-config\""
Jul 08 16:59:13.517741 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.517595    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-806a8-serving-cert\""
Jul 08 16:59:13.528552 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.528530    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"]
Jul 08 16:59:13.635514 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.635470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dde80ee5-3058-43da-b7f4-0ff1557cb67d-proxy-tls\") pod \"ensemble-graph-806a8-d67b8df85-lk848\" (UID: \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\") " pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:13.635695 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.635545    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde80ee5-3058-43da-b7f4-0ff1557cb67d-openshift-service-ca-bundle\") pod \"ensemble-graph-806a8-d67b8df85-lk848\" (UID: \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\") " pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:13.736158 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.736118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde80ee5-3058-43da-b7f4-0ff1557cb67d-openshift-service-ca-bundle\") pod \"ensemble-graph-806a8-d67b8df85-lk848\" (UID: \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\") " pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:13.736352 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.736167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dde80ee5-3058-43da-b7f4-0ff1557cb67d-proxy-tls\") pod \"ensemble-graph-806a8-d67b8df85-lk848\" (UID: \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\") " pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:13.736764 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.736743    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde80ee5-3058-43da-b7f4-0ff1557cb67d-openshift-service-ca-bundle\") pod \"ensemble-graph-806a8-d67b8df85-lk848\" (UID: \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\") " pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:13.738649 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.738632    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dde80ee5-3058-43da-b7f4-0ff1557cb67d-proxy-tls\") pod \"ensemble-graph-806a8-d67b8df85-lk848\" (UID: \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\") " pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:13.824720 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.824619    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:13.952433 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:13.952409    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"]
Jul 08 16:59:13.954861 ip-10-0-129-12 kubenswrapper[2583]: W0708 16:59:13.954829    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde80ee5_3058_43da_b7f4_0ff1557cb67d.slice/crio-b04a6243fdfc1706079d4bdecc9defb983e823c59bbb73d6d3beeac6a44c9377 WatchSource:0}: Error finding container b04a6243fdfc1706079d4bdecc9defb983e823c59bbb73d6d3beeac6a44c9377: Status 404 returned error can't find the container with id b04a6243fdfc1706079d4bdecc9defb983e823c59bbb73d6d3beeac6a44c9377
Jul 08 16:59:14.681044 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:14.681010    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:59:14.715933 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:14.715901    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" event={"ID":"dde80ee5-3058-43da-b7f4-0ff1557cb67d","Type":"ContainerStarted","Data":"aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818"}
Jul 08 16:59:14.716081 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:14.715955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" event={"ID":"dde80ee5-3058-43da-b7f4-0ff1557cb67d","Type":"ContainerStarted","Data":"b04a6243fdfc1706079d4bdecc9defb983e823c59bbb73d6d3beeac6a44c9377"}
Jul 08 16:59:14.716081 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:14.715986    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:14.732589 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:14.732538    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" podStartSLOduration=1.732522646 podStartE2EDuration="1.732522646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:59:14.732342877 +0000 UTC m=+1512.276696026" watchObservedRunningTime="2026-07-08 16:59:14.732522646 +0000 UTC m=+1512.276875796"
Jul 08 16:59:19.680346 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:19.680302    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:59:20.725126 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:20.725097    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 16:59:24.681136 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:24.681044    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:59:24.681593 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:24.681166    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:29.680226 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:29.680190    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:59:34.681078 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:34.681040    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:59:39.680655 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:39.680617    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 16:59:43.249996 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.249966    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:43.370108 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.370031    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44269f71-20e0-4978-8a33-1ba022775385-proxy-tls\") pod \"44269f71-20e0-4978-8a33-1ba022775385\" (UID: \"44269f71-20e0-4978-8a33-1ba022775385\") "
Jul 08 16:59:43.370108 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.370076    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44269f71-20e0-4978-8a33-1ba022775385-openshift-service-ca-bundle\") pod \"44269f71-20e0-4978-8a33-1ba022775385\" (UID: \"44269f71-20e0-4978-8a33-1ba022775385\") "
Jul 08 16:59:43.370511 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.370483    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44269f71-20e0-4978-8a33-1ba022775385-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "44269f71-20e0-4978-8a33-1ba022775385" (UID: "44269f71-20e0-4978-8a33-1ba022775385"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:59:43.372245 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.372225    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44269f71-20e0-4978-8a33-1ba022775385-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "44269f71-20e0-4978-8a33-1ba022775385" (UID: "44269f71-20e0-4978-8a33-1ba022775385"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:59:43.471286 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.471235    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44269f71-20e0-4978-8a33-1ba022775385-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:59:43.471286 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.471282    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44269f71-20e0-4978-8a33-1ba022775385-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 16:59:43.832857 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.832824    2583 generic.go:356] "Generic (PLEG): container finished" podID="44269f71-20e0-4978-8a33-1ba022775385" containerID="4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc" exitCode=0
Jul 08 16:59:43.833042 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.832871    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" event={"ID":"44269f71-20e0-4978-8a33-1ba022775385","Type":"ContainerDied","Data":"4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc"}
Jul 08 16:59:43.833042 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.832908    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh" event={"ID":"44269f71-20e0-4978-8a33-1ba022775385","Type":"ContainerDied","Data":"f7104c096b157091d27d4ac0503219f170af0f9f25d9ca5c481727c882b72f73"}
Jul 08 16:59:43.833042 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.832929    2583 scope.go:117] "RemoveContainer" containerID="4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc"
Jul 08 16:59:43.833042 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.832872    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"
Jul 08 16:59:43.841028 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.841005    2583 scope.go:117] "RemoveContainer" containerID="4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc"
Jul 08 16:59:43.841270 ip-10-0-129-12 kubenswrapper[2583]: E0708 16:59:43.841250    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc\": container with ID starting with 4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc not found: ID does not exist" containerID="4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc"
Jul 08 16:59:43.841327 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.841280    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc"} err="failed to get container status \"4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc\": rpc error: code = NotFound desc = could not find container \"4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc\": container with ID starting with 4b1c7f019b44b6bd592ac14323bb82d44d304229a96962cc9750cf20598688dc not found: ID does not exist"
Jul 08 16:59:43.854438 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.854416    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"]
Jul 08 16:59:43.858142 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:43.858120    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-178bc-84fb875cf-fkbbh"]
Jul 08 16:59:45.004503 ip-10-0-129-12 kubenswrapper[2583]: I0708 16:59:45.004472    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44269f71-20e0-4978-8a33-1ba022775385" path="/var/lib/kubelet/pods/44269f71-20e0-4978-8a33-1ba022775385/volumes"
Jul 08 17:00:13.331037 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.331002    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"]
Jul 08 17:00:13.331551 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.331312    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc"
Jul 08 17:00:13.331551 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.331324    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc"
Jul 08 17:00:13.331551 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.331393    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="44269f71-20e0-4978-8a33-1ba022775385" containerName="sequence-graph-178bc"
Jul 08 17:00:13.335399 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.335381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:00:13.338065 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.338050    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-b2f8c-serving-cert\""
Jul 08 17:00:13.338150 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.338050    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-b2f8c-kube-rbac-proxy-sar-config\""
Jul 08 17:00:13.343049 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.343025    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"]
Jul 08 17:00:13.390962 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.390926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eab1a8c-0388-4847-97a7-6edf3207871d-openshift-service-ca-bundle\") pod \"sequence-graph-b2f8c-754875c9d4-hlsk8\" (UID: \"5eab1a8c-0388-4847-97a7-6edf3207871d\") " pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:00:13.391126 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.390974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5eab1a8c-0388-4847-97a7-6edf3207871d-proxy-tls\") pod \"sequence-graph-b2f8c-754875c9d4-hlsk8\" (UID: \"5eab1a8c-0388-4847-97a7-6edf3207871d\") " pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:00:13.491930 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.491899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eab1a8c-0388-4847-97a7-6edf3207871d-openshift-service-ca-bundle\") pod \"sequence-graph-b2f8c-754875c9d4-hlsk8\" (UID: \"5eab1a8c-0388-4847-97a7-6edf3207871d\") " pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:00:13.492129 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.491958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5eab1a8c-0388-4847-97a7-6edf3207871d-proxy-tls\") pod \"sequence-graph-b2f8c-754875c9d4-hlsk8\" (UID: \"5eab1a8c-0388-4847-97a7-6edf3207871d\") " pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:00:13.492591 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.492571    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eab1a8c-0388-4847-97a7-6edf3207871d-openshift-service-ca-bundle\") pod \"sequence-graph-b2f8c-754875c9d4-hlsk8\" (UID: \"5eab1a8c-0388-4847-97a7-6edf3207871d\") " pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:00:13.494492 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.494472    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5eab1a8c-0388-4847-97a7-6edf3207871d-proxy-tls\") pod \"sequence-graph-b2f8c-754875c9d4-hlsk8\" (UID: \"5eab1a8c-0388-4847-97a7-6edf3207871d\") " pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:00:13.646646 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.646564    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:00:13.775276 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.775253    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"]
Jul 08 17:00:13.777630 ip-10-0-129-12 kubenswrapper[2583]: W0708 17:00:13.777596    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eab1a8c_0388_4847_97a7_6edf3207871d.slice/crio-b9d959cd36642b013c918175ef1281e7f2a54c90b331df2d540ecfa05b1773bd WatchSource:0}: Error finding container b9d959cd36642b013c918175ef1281e7f2a54c90b331df2d540ecfa05b1773bd: Status 404 returned error can't find the container with id b9d959cd36642b013c918175ef1281e7f2a54c90b331df2d540ecfa05b1773bd
Jul 08 17:00:13.952843 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.952806    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" event={"ID":"5eab1a8c-0388-4847-97a7-6edf3207871d","Type":"ContainerStarted","Data":"ff11559f199f6caf0f1c946551ab79329bce37592a2410fa85bfdf6e4586eecd"}
Jul 08 17:00:13.953019 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.952863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" event={"ID":"5eab1a8c-0388-4847-97a7-6edf3207871d","Type":"ContainerStarted","Data":"b9d959cd36642b013c918175ef1281e7f2a54c90b331df2d540ecfa05b1773bd"}
Jul 08 17:00:13.953019 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.952902    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:00:13.969210 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:13.968724    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" podStartSLOduration=0.96870293 podStartE2EDuration="968.70293ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:00:13.968025293 +0000 UTC m=+1571.512378511" watchObservedRunningTime="2026-07-08 17:00:13.96870293 +0000 UTC m=+1571.513056083"
Jul 08 17:00:19.965447 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:00:19.965412    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:04:03.011437 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:04:03.011402    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:04:03.012911 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:04:03.012888    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:04:03.016957 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:04:03.016926    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:04:03.018173 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:04:03.018150    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:07:28.089021 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:28.088957    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"]
Jul 08 17:07:28.091518 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:28.089233    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8" containerID="cri-o://aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818" gracePeriod=30
Jul 08 17:07:30.724113 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:30.724078    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:07:35.723847 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:35.723805    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:07:40.723518 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:40.723476    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:07:40.723925 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:40.723586    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 17:07:45.723896 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:45.723856    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:07:50.723598 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:50.723558    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:07:55.723463 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:55.723423    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:07:58.237380 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.237354    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 17:07:58.282770 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.282735    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde80ee5-3058-43da-b7f4-0ff1557cb67d-openshift-service-ca-bundle\") pod \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\" (UID: \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\") "
Jul 08 17:07:58.282939 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.282819    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dde80ee5-3058-43da-b7f4-0ff1557cb67d-proxy-tls\") pod \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\" (UID: \"dde80ee5-3058-43da-b7f4-0ff1557cb67d\") "
Jul 08 17:07:58.283107 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.283084    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde80ee5-3058-43da-b7f4-0ff1557cb67d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "dde80ee5-3058-43da-b7f4-0ff1557cb67d" (UID: "dde80ee5-3058-43da-b7f4-0ff1557cb67d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:07:58.285027 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.285005    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dde80ee5-3058-43da-b7f4-0ff1557cb67d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "dde80ee5-3058-43da-b7f4-0ff1557cb67d" (UID: "dde80ee5-3058-43da-b7f4-0ff1557cb67d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:07:58.384128 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.384020    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dde80ee5-3058-43da-b7f4-0ff1557cb67d-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:07:58.384128 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.384069    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dde80ee5-3058-43da-b7f4-0ff1557cb67d-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:07:58.798110 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.798073    2583 generic.go:356] "Generic (PLEG): container finished" podID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerID="aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818" exitCode=0
Jul 08 17:07:58.798286 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.798119    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" event={"ID":"dde80ee5-3058-43da-b7f4-0ff1557cb67d","Type":"ContainerDied","Data":"aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818"}
Jul 08 17:07:58.798286 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.798142    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"
Jul 08 17:07:58.798286 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.798187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848" event={"ID":"dde80ee5-3058-43da-b7f4-0ff1557cb67d","Type":"ContainerDied","Data":"b04a6243fdfc1706079d4bdecc9defb983e823c59bbb73d6d3beeac6a44c9377"}
Jul 08 17:07:58.798286 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.798208    2583 scope.go:117] "RemoveContainer" containerID="aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818"
Jul 08 17:07:58.806552 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.806526    2583 scope.go:117] "RemoveContainer" containerID="aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818"
Jul 08 17:07:58.806874 ip-10-0-129-12 kubenswrapper[2583]: E0708 17:07:58.806844    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818\": container with ID starting with aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818 not found: ID does not exist" containerID="aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818"
Jul 08 17:07:58.806945 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.806884    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818"} err="failed to get container status \"aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818\": rpc error: code = NotFound desc = could not find container \"aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818\": container with ID starting with aaeef646e957eef6d162362da114bccee2bdd5afb3c9040b1131e9294faa1818 not found: ID does not exist"
Jul 08 17:07:58.821950 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.821918    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"]
Jul 08 17:07:58.825225 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:58.825200    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-806a8-d67b8df85-lk848"]
Jul 08 17:07:59.005297 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:07:59.005263    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" path="/var/lib/kubelet/pods/dde80ee5-3058-43da-b7f4-0ff1557cb67d/volumes"
Jul 08 17:08:27.844771 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:27.844691    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"]
Jul 08 17:08:27.845357 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:27.844909    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c" containerID="cri-o://ff11559f199f6caf0f1c946551ab79329bce37592a2410fa85bfdf6e4586eecd" gracePeriod=30
Jul 08 17:08:28.336258 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.336219    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"]
Jul 08 17:08:28.336556 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.336540    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8"
Jul 08 17:08:28.336637 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.336560    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8"
Jul 08 17:08:28.336676 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.336647    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde80ee5-3058-43da-b7f4-0ff1557cb67d" containerName="ensemble-graph-806a8"
Jul 08 17:08:28.339354 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.339339    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:28.342419 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.342391    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-2c597-serving-cert\""
Jul 08 17:08:28.342562 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.342516    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-2c597-kube-rbac-proxy-sar-config\""
Jul 08 17:08:28.351784 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.351764    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"]
Jul 08 17:08:28.401479 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.401421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae370551-afac-4153-9976-5547659ed56f-proxy-tls\") pod \"splitter-graph-2c597-5f8659dbdc-8ch6c\" (UID: \"ae370551-afac-4153-9976-5547659ed56f\") " pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:28.401676 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.401559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae370551-afac-4153-9976-5547659ed56f-openshift-service-ca-bundle\") pod \"splitter-graph-2c597-5f8659dbdc-8ch6c\" (UID: \"ae370551-afac-4153-9976-5547659ed56f\") " pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:28.502484 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.502419    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae370551-afac-4153-9976-5547659ed56f-openshift-service-ca-bundle\") pod \"splitter-graph-2c597-5f8659dbdc-8ch6c\" (UID: \"ae370551-afac-4153-9976-5547659ed56f\") " pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:28.502640 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.502495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae370551-afac-4153-9976-5547659ed56f-proxy-tls\") pod \"splitter-graph-2c597-5f8659dbdc-8ch6c\" (UID: \"ae370551-afac-4153-9976-5547659ed56f\") " pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:28.502640 ip-10-0-129-12 kubenswrapper[2583]: E0708 17:08:28.502603    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-2c597-serving-cert: secret "splitter-graph-2c597-serving-cert" not found
Jul 08 17:08:28.502802 ip-10-0-129-12 kubenswrapper[2583]: E0708 17:08:28.502659    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae370551-afac-4153-9976-5547659ed56f-proxy-tls podName:ae370551-afac-4153-9976-5547659ed56f nodeName:}" failed. No retries permitted until 2026-07-08 17:08:29.002643554 +0000 UTC m=+2066.546996683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ae370551-afac-4153-9976-5547659ed56f-proxy-tls") pod "splitter-graph-2c597-5f8659dbdc-8ch6c" (UID: "ae370551-afac-4153-9976-5547659ed56f") : secret "splitter-graph-2c597-serving-cert" not found
Jul 08 17:08:28.503061 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:28.503039    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae370551-afac-4153-9976-5547659ed56f-openshift-service-ca-bundle\") pod \"splitter-graph-2c597-5f8659dbdc-8ch6c\" (UID: \"ae370551-afac-4153-9976-5547659ed56f\") " pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:29.005216 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:29.005188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae370551-afac-4153-9976-5547659ed56f-proxy-tls\") pod \"splitter-graph-2c597-5f8659dbdc-8ch6c\" (UID: \"ae370551-afac-4153-9976-5547659ed56f\") " pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:29.007729 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:29.007709    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae370551-afac-4153-9976-5547659ed56f-proxy-tls\") pod \"splitter-graph-2c597-5f8659dbdc-8ch6c\" (UID: \"ae370551-afac-4153-9976-5547659ed56f\") " pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:29.249107 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:29.249073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:29.382389 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:29.382248    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"]
Jul 08 17:08:29.384524 ip-10-0-129-12 kubenswrapper[2583]: W0708 17:08:29.384501    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae370551_afac_4153_9976_5547659ed56f.slice/crio-7c9423efe313ac693dcb440edd591b047cfa1ea4e80c861030fa1d0a25827e5c WatchSource:0}: Error finding container 7c9423efe313ac693dcb440edd591b047cfa1ea4e80c861030fa1d0a25827e5c: Status 404 returned error can't find the container with id 7c9423efe313ac693dcb440edd591b047cfa1ea4e80c861030fa1d0a25827e5c
Jul 08 17:08:29.913065 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:29.913027    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" event={"ID":"ae370551-afac-4153-9976-5547659ed56f","Type":"ContainerStarted","Data":"85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9"}
Jul 08 17:08:29.913248 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:29.913082    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" event={"ID":"ae370551-afac-4153-9976-5547659ed56f","Type":"ContainerStarted","Data":"7c9423efe313ac693dcb440edd591b047cfa1ea4e80c861030fa1d0a25827e5c"}
Jul 08 17:08:29.913248 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:29.913171    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:29.933601 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:29.933554    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" podStartSLOduration=1.9335379179999999 podStartE2EDuration="1.933537918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:08:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:08:29.93289482 +0000 UTC m=+2067.477247982" watchObservedRunningTime="2026-07-08 17:08:29.933537918 +0000 UTC m=+2067.477891109"
Jul 08 17:08:29.963170 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:29.963136    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:34.962368 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:34.962324    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:35.923110 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:35.923081    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:38.429812 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:38.429725    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"]
Jul 08 17:08:38.430237 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:38.429977    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597" containerID="cri-o://85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9" gracePeriod=30
Jul 08 17:08:39.962731 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:39.962694    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:39.963121 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:39.962822    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:08:40.920815 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:40.920776    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:44.962415 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:44.962378    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:45.920849 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:45.920809    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:49.962377 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:49.962329    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:50.921045 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:50.921006    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:50.921228 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:50.921113    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:08:54.962860 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:54.962805    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:55.921520 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:55.921475    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:08:58.024629 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.024592    2583 generic.go:356] "Generic (PLEG): container finished" podID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerID="ff11559f199f6caf0f1c946551ab79329bce37592a2410fa85bfdf6e4586eecd" exitCode=137
Jul 08 17:08:58.024936 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.024658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" event={"ID":"5eab1a8c-0388-4847-97a7-6edf3207871d","Type":"ContainerDied","Data":"ff11559f199f6caf0f1c946551ab79329bce37592a2410fa85bfdf6e4586eecd"}
Jul 08 17:08:58.024936 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.024706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8" event={"ID":"5eab1a8c-0388-4847-97a7-6edf3207871d","Type":"ContainerDied","Data":"b9d959cd36642b013c918175ef1281e7f2a54c90b331df2d540ecfa05b1773bd"}
Jul 08 17:08:58.024936 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.024722    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9d959cd36642b013c918175ef1281e7f2a54c90b331df2d540ecfa05b1773bd"
Jul 08 17:08:58.032348 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.032322    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:08:58.141555 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.141449    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5eab1a8c-0388-4847-97a7-6edf3207871d-proxy-tls\") pod \"5eab1a8c-0388-4847-97a7-6edf3207871d\" (UID: \"5eab1a8c-0388-4847-97a7-6edf3207871d\") "
Jul 08 17:08:58.141555 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.141534    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eab1a8c-0388-4847-97a7-6edf3207871d-openshift-service-ca-bundle\") pod \"5eab1a8c-0388-4847-97a7-6edf3207871d\" (UID: \"5eab1a8c-0388-4847-97a7-6edf3207871d\") "
Jul 08 17:08:58.141964 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.141937    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eab1a8c-0388-4847-97a7-6edf3207871d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5eab1a8c-0388-4847-97a7-6edf3207871d" (UID: "5eab1a8c-0388-4847-97a7-6edf3207871d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:08:58.143725 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.143702    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eab1a8c-0388-4847-97a7-6edf3207871d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5eab1a8c-0388-4847-97a7-6edf3207871d" (UID: "5eab1a8c-0388-4847-97a7-6edf3207871d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:08:58.243016 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.242980    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eab1a8c-0388-4847-97a7-6edf3207871d-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:08:58.243016 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:58.243011    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5eab1a8c-0388-4847-97a7-6edf3207871d-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:08:59.028422 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:59.028391    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"
Jul 08 17:08:59.073742 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:59.073709    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"]
Jul 08 17:08:59.078905 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:08:59.078879    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b2f8c-754875c9d4-hlsk8"]
Jul 08 17:09:00.920930 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:00.920894    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:09:01.004549 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:01.004510    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" path="/var/lib/kubelet/pods/5eab1a8c-0388-4847-97a7-6edf3207871d/volumes"
Jul 08 17:09:03.033346 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:03.033315    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:09:03.035171 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:03.035148    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:09:03.038625 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:03.038596    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:09:03.040218 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:03.040200    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:09:03.095057 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:03.095030    2583 scope.go:117] "RemoveContainer" containerID="ff11559f199f6caf0f1c946551ab79329bce37592a2410fa85bfdf6e4586eecd"
Jul 08 17:09:05.921716 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:05.921675    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:09:08.579060 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:08.579030    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:09:08.721819 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:08.721738    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae370551-afac-4153-9976-5547659ed56f-openshift-service-ca-bundle\") pod \"ae370551-afac-4153-9976-5547659ed56f\" (UID: \"ae370551-afac-4153-9976-5547659ed56f\") "
Jul 08 17:09:08.721819 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:08.721790    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae370551-afac-4153-9976-5547659ed56f-proxy-tls\") pod \"ae370551-afac-4153-9976-5547659ed56f\" (UID: \"ae370551-afac-4153-9976-5547659ed56f\") "
Jul 08 17:09:08.722159 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:08.722132    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae370551-afac-4153-9976-5547659ed56f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ae370551-afac-4153-9976-5547659ed56f" (UID: "ae370551-afac-4153-9976-5547659ed56f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:09:08.723924 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:08.723899    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae370551-afac-4153-9976-5547659ed56f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ae370551-afac-4153-9976-5547659ed56f" (UID: "ae370551-afac-4153-9976-5547659ed56f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:09:08.823210 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:08.823175    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ae370551-afac-4153-9976-5547659ed56f-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:09:08.823210 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:08.823206    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae370551-afac-4153-9976-5547659ed56f-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:09:09.067302 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:09.067264    2583 generic.go:356] "Generic (PLEG): container finished" podID="ae370551-afac-4153-9976-5547659ed56f" containerID="85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9" exitCode=0
Jul 08 17:09:09.067493 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:09.067312    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" event={"ID":"ae370551-afac-4153-9976-5547659ed56f","Type":"ContainerDied","Data":"85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9"}
Jul 08 17:09:09.067493 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:09.067352    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c" event={"ID":"ae370551-afac-4153-9976-5547659ed56f","Type":"ContainerDied","Data":"7c9423efe313ac693dcb440edd591b047cfa1ea4e80c861030fa1d0a25827e5c"}
Jul 08 17:09:09.067493 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:09.067372    2583 scope.go:117] "RemoveContainer" containerID="85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9"
Jul 08 17:09:09.067493 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:09.067313    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"
Jul 08 17:09:09.075509 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:09.075488    2583 scope.go:117] "RemoveContainer" containerID="85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9"
Jul 08 17:09:09.075791 ip-10-0-129-12 kubenswrapper[2583]: E0708 17:09:09.075773    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9\": container with ID starting with 85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9 not found: ID does not exist" containerID="85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9"
Jul 08 17:09:09.075845 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:09.075804    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9"} err="failed to get container status \"85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9\": rpc error: code = NotFound desc = could not find container \"85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9\": container with ID starting with 85cd97f22b7a7babb68123205360bc06a2e9df83f091b7a74a9419ca8ea91af9 not found: ID does not exist"
Jul 08 17:09:09.082791 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:09.082752    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"]
Jul 08 17:09:09.085769 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:09.085748    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-2c597-5f8659dbdc-8ch6c"]
Jul 08 17:09:11.004902 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:11.004869    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae370551-afac-4153-9976-5547659ed56f" path="/var/lib/kubelet/pods/ae370551-afac-4153-9976-5547659ed56f/volumes"
Jul 08 17:09:28.096898 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.096854    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"]
Jul 08 17:09:28.097380 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.097253    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597"
Jul 08 17:09:28.097380 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.097270    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597"
Jul 08 17:09:28.097380 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.097292    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c"
Jul 08 17:09:28.097380 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.097302    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c"
Jul 08 17:09:28.097380 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.097367    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eab1a8c-0388-4847-97a7-6edf3207871d" containerName="sequence-graph-b2f8c"
Jul 08 17:09:28.097380 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.097378    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae370551-afac-4153-9976-5547659ed56f" containerName="splitter-graph-2c597"
Jul 08 17:09:28.101641 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.101619    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:28.104263 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.104238    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-d09b9-kube-rbac-proxy-sar-config\""
Jul 08 17:09:28.104400 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.104365    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-d09b9-serving-cert\""
Jul 08 17:09:28.104400 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.104374    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 17:09:28.104533 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.104409    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-gs76g\""
Jul 08 17:09:28.108087 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.108066    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"]
Jul 08 17:09:28.161157 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.161120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30bac7f5-9029-4449-9acd-55ed5acb46cb-proxy-tls\") pod \"switch-graph-d09b9-bd8cfc589-h94lt\" (UID: \"30bac7f5-9029-4449-9acd-55ed5acb46cb\") " pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:28.161357 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.161161    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bac7f5-9029-4449-9acd-55ed5acb46cb-openshift-service-ca-bundle\") pod \"switch-graph-d09b9-bd8cfc589-h94lt\" (UID: \"30bac7f5-9029-4449-9acd-55ed5acb46cb\") " pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:28.261974 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.261933    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30bac7f5-9029-4449-9acd-55ed5acb46cb-proxy-tls\") pod \"switch-graph-d09b9-bd8cfc589-h94lt\" (UID: \"30bac7f5-9029-4449-9acd-55ed5acb46cb\") " pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:28.262172 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.261989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bac7f5-9029-4449-9acd-55ed5acb46cb-openshift-service-ca-bundle\") pod \"switch-graph-d09b9-bd8cfc589-h94lt\" (UID: \"30bac7f5-9029-4449-9acd-55ed5acb46cb\") " pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:28.262172 ip-10-0-129-12 kubenswrapper[2583]: E0708 17:09:28.262103    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-d09b9-serving-cert: secret "switch-graph-d09b9-serving-cert" not found
Jul 08 17:09:28.262267 ip-10-0-129-12 kubenswrapper[2583]: E0708 17:09:28.262179    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30bac7f5-9029-4449-9acd-55ed5acb46cb-proxy-tls podName:30bac7f5-9029-4449-9acd-55ed5acb46cb nodeName:}" failed. No retries permitted until 2026-07-08 17:09:28.762158137 +0000 UTC m=+2126.306511266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/30bac7f5-9029-4449-9acd-55ed5acb46cb-proxy-tls") pod "switch-graph-d09b9-bd8cfc589-h94lt" (UID: "30bac7f5-9029-4449-9acd-55ed5acb46cb") : secret "switch-graph-d09b9-serving-cert" not found
Jul 08 17:09:28.262807 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.262789    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bac7f5-9029-4449-9acd-55ed5acb46cb-openshift-service-ca-bundle\") pod \"switch-graph-d09b9-bd8cfc589-h94lt\" (UID: \"30bac7f5-9029-4449-9acd-55ed5acb46cb\") " pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:28.766553 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.766515    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30bac7f5-9029-4449-9acd-55ed5acb46cb-proxy-tls\") pod \"switch-graph-d09b9-bd8cfc589-h94lt\" (UID: \"30bac7f5-9029-4449-9acd-55ed5acb46cb\") " pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:28.769099 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:28.769078    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30bac7f5-9029-4449-9acd-55ed5acb46cb-proxy-tls\") pod \"switch-graph-d09b9-bd8cfc589-h94lt\" (UID: \"30bac7f5-9029-4449-9acd-55ed5acb46cb\") " pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:29.013399 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:29.013083    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:29.151434 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:29.151404    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"]
Jul 08 17:09:29.153828 ip-10-0-129-12 kubenswrapper[2583]: W0708 17:09:29.153800    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bac7f5_9029_4449_9acd_55ed5acb46cb.slice/crio-7c27bd88563e38b2c967de3b56c3fc6a147940f889eefcd35da478a6cf856ee0 WatchSource:0}: Error finding container 7c27bd88563e38b2c967de3b56c3fc6a147940f889eefcd35da478a6cf856ee0: Status 404 returned error can't find the container with id 7c27bd88563e38b2c967de3b56c3fc6a147940f889eefcd35da478a6cf856ee0
Jul 08 17:09:30.147918 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:30.147881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" event={"ID":"30bac7f5-9029-4449-9acd-55ed5acb46cb","Type":"ContainerStarted","Data":"0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f"}
Jul 08 17:09:30.148184 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:30.147935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" event={"ID":"30bac7f5-9029-4449-9acd-55ed5acb46cb","Type":"ContainerStarted","Data":"7c27bd88563e38b2c967de3b56c3fc6a147940f889eefcd35da478a6cf856ee0"}
Jul 08 17:09:30.148184 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:30.147985    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:30.164706 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:30.164650    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" podStartSLOduration=2.164635488 podStartE2EDuration="2.164635488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:30.164176436 +0000 UTC m=+2127.708529587" watchObservedRunningTime="2026-07-08 17:09:30.164635488 +0000 UTC m=+2127.708988638"
Jul 08 17:09:36.157530 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:36.157498    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:09:48.653532 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.653434    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"]
Jul 08 17:09:48.656392 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.656375    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:48.658911 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.658884    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-ab489-serving-cert\""
Jul 08 17:09:48.659040 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.658889    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-ab489-kube-rbac-proxy-sar-config\""
Jul 08 17:09:48.665638 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.665612    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"]
Jul 08 17:09:48.721993 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.721950    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-openshift-service-ca-bundle\") pod \"splitter-graph-ab489-66bcc5c8db-csrnl\" (UID: \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\") " pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:48.722187 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.722092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-proxy-tls\") pod \"splitter-graph-ab489-66bcc5c8db-csrnl\" (UID: \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\") " pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:48.822827 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.822778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-proxy-tls\") pod \"splitter-graph-ab489-66bcc5c8db-csrnl\" (UID: \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\") " pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:48.822827 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.822831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-openshift-service-ca-bundle\") pod \"splitter-graph-ab489-66bcc5c8db-csrnl\" (UID: \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\") " pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:48.823052 ip-10-0-129-12 kubenswrapper[2583]: E0708 17:09:48.822955    2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-ab489-serving-cert: secret "splitter-graph-ab489-serving-cert" not found
Jul 08 17:09:48.823052 ip-10-0-129-12 kubenswrapper[2583]: E0708 17:09:48.823033    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-proxy-tls podName:7074dee0-91c1-468c-be9f-f2bfa6ff2c18 nodeName:}" failed. No retries permitted until 2026-07-08 17:09:49.323012412 +0000 UTC m=+2146.867365555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-proxy-tls") pod "splitter-graph-ab489-66bcc5c8db-csrnl" (UID: "7074dee0-91c1-468c-be9f-f2bfa6ff2c18") : secret "splitter-graph-ab489-serving-cert" not found
Jul 08 17:09:48.823438 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:48.823418    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-openshift-service-ca-bundle\") pod \"splitter-graph-ab489-66bcc5c8db-csrnl\" (UID: \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\") " pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:49.325761 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:49.325722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-proxy-tls\") pod \"splitter-graph-ab489-66bcc5c8db-csrnl\" (UID: \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\") " pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:49.328291 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:49.328271    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-proxy-tls\") pod \"splitter-graph-ab489-66bcc5c8db-csrnl\" (UID: \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\") " pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:49.567637 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:49.567595    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:49.698525 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:49.698491    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"]
Jul 08 17:09:49.701423 ip-10-0-129-12 kubenswrapper[2583]: W0708 17:09:49.701390    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7074dee0_91c1_468c_be9f_f2bfa6ff2c18.slice/crio-bfbd35dd614070091c5e8a243eab8d6a74b6231cc3aa88533e69ed9877196bbf WatchSource:0}: Error finding container bfbd35dd614070091c5e8a243eab8d6a74b6231cc3aa88533e69ed9877196bbf: Status 404 returned error can't find the container with id bfbd35dd614070091c5e8a243eab8d6a74b6231cc3aa88533e69ed9877196bbf
Jul 08 17:09:50.225128 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:50.225086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" event={"ID":"7074dee0-91c1-468c-be9f-f2bfa6ff2c18","Type":"ContainerStarted","Data":"9bbd4243d98bea4f9811df28d7156e34874ada489cf72e4289fa12758fa644ad"}
Jul 08 17:09:50.225329 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:50.225139    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" event={"ID":"7074dee0-91c1-468c-be9f-f2bfa6ff2c18","Type":"ContainerStarted","Data":"bfbd35dd614070091c5e8a243eab8d6a74b6231cc3aa88533e69ed9877196bbf"}
Jul 08 17:09:50.225329 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:50.225212    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:09:50.247346 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:50.244447    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" podStartSLOduration=2.244415905 podStartE2EDuration="2.244415905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:09:50.241577832 +0000 UTC m=+2147.785930982" watchObservedRunningTime="2026-07-08 17:09:50.244415905 +0000 UTC m=+2147.788769055"
Jul 08 17:09:56.235076 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:09:56.234989    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:14:03.056228 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:14:03.056194    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:14:03.058576 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:14:03.058417    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:14:03.061241 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:14:03.061220    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:14:03.063766 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:14:03.063749    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:18:03.275354 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:03.275321    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"]
Jul 08 17:18:03.275994 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:03.275593    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489" containerID="cri-o://9bbd4243d98bea4f9811df28d7156e34874ada489cf72e4289fa12758fa644ad" gracePeriod=30
Jul 08 17:18:06.232896 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:06.232860    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:18:11.232990 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:11.232942    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:18:16.232946 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:16.232899    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:18:16.233351 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:16.233006    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:18:21.233301 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:21.233250    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:18:26.232566 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:26.232522    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:18:31.232229 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:31.232184    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:18:33.345758 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:33.345722    2583 generic.go:356] "Generic (PLEG): container finished" podID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerID="9bbd4243d98bea4f9811df28d7156e34874ada489cf72e4289fa12758fa644ad" exitCode=0
Jul 08 17:18:33.346121 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:33.345788    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" event={"ID":"7074dee0-91c1-468c-be9f-f2bfa6ff2c18","Type":"ContainerDied","Data":"9bbd4243d98bea4f9811df28d7156e34874ada489cf72e4289fa12758fa644ad"}
Jul 08 17:18:33.426723 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:33.426697    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:18:33.531685 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:33.531605    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-openshift-service-ca-bundle\") pod \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\" (UID: \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\") "
Jul 08 17:18:33.531685 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:33.531652    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-proxy-tls\") pod \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\" (UID: \"7074dee0-91c1-468c-be9f-f2bfa6ff2c18\") "
Jul 08 17:18:33.531945 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:33.531924    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "7074dee0-91c1-468c-be9f-f2bfa6ff2c18" (UID: "7074dee0-91c1-468c-be9f-f2bfa6ff2c18"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:18:33.533780 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:33.533753    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7074dee0-91c1-468c-be9f-f2bfa6ff2c18" (UID: "7074dee0-91c1-468c-be9f-f2bfa6ff2c18"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:18:33.632647 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:33.632611    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:18:33.632647 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:33.632643    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7074dee0-91c1-468c-be9f-f2bfa6ff2c18-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:18:34.351231 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:34.351190    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl" event={"ID":"7074dee0-91c1-468c-be9f-f2bfa6ff2c18","Type":"ContainerDied","Data":"bfbd35dd614070091c5e8a243eab8d6a74b6231cc3aa88533e69ed9877196bbf"}
Jul 08 17:18:34.351231 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:34.351220    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"
Jul 08 17:18:34.351729 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:34.351266    2583 scope.go:117] "RemoveContainer" containerID="9bbd4243d98bea4f9811df28d7156e34874ada489cf72e4289fa12758fa644ad"
Jul 08 17:18:34.370300 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:34.370275    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"]
Jul 08 17:18:34.373581 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:34.373557    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-ab489-66bcc5c8db-csrnl"]
Jul 08 17:18:35.005731 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:18:35.005700    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" path="/var/lib/kubelet/pods/7074dee0-91c1-468c-be9f-f2bfa6ff2c18/volumes"
Jul 08 17:19:03.078807 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:19:03.078117    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:19:03.082713 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:19:03.082689    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:19:03.083800 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:19:03.083779    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:19:03.087387 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:19:03.087371    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:24:03.100069 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:24:03.099953    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:24:03.104254 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:24:03.104234    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:24:03.105415 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:24:03.105394    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:24:03.108981 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:24:03.108960    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:25:47.443865 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:25:47.443824    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"]
Jul 08 17:25:47.444408 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:25:47.444034    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9" containerID="cri-o://0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f" gracePeriod=30
Jul 08 17:25:51.156397 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:25:51.156358    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:25:56.155685 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:25:56.155647    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:26:01.156160 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:01.156119    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:26:01.156574 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:01.156245    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:26:05.038882 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:05.038855    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:05.924764 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:05.924732    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:06.155747 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:06.155712    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:26:06.762127 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:06.762103    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:07.587954 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:07.587930    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:08.403931 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:08.403899    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:09.237334 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:09.237311    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:10.072423 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:10.072396    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:10.882361 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:10.882331    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:11.156701 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:11.156616    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:26:11.722421 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:11.722388    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:12.562419 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:12.562390    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:13.391527 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:13.391493    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:14.199319 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:14.199296    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:15.014934 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:15.014909    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:15.879881 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:15.879854    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-d09b9-bd8cfc589-h94lt_30bac7f5-9029-4449-9acd-55ed5acb46cb/switch-graph-d09b9/0.log"
Jul 08 17:26:16.156142 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:16.156053    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:26:17.590666 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:17.590642    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:26:17.610942 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:17.610907    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bac7f5-9029-4449-9acd-55ed5acb46cb-openshift-service-ca-bundle\") pod \"30bac7f5-9029-4449-9acd-55ed5acb46cb\" (UID: \"30bac7f5-9029-4449-9acd-55ed5acb46cb\") "
Jul 08 17:26:17.611092 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:17.610952    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30bac7f5-9029-4449-9acd-55ed5acb46cb-proxy-tls\") pod \"30bac7f5-9029-4449-9acd-55ed5acb46cb\" (UID: \"30bac7f5-9029-4449-9acd-55ed5acb46cb\") "
Jul 08 17:26:17.611251 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:17.611228    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30bac7f5-9029-4449-9acd-55ed5acb46cb-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "30bac7f5-9029-4449-9acd-55ed5acb46cb" (UID: "30bac7f5-9029-4449-9acd-55ed5acb46cb"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:26:17.613197 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:17.613170    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30bac7f5-9029-4449-9acd-55ed5acb46cb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "30bac7f5-9029-4449-9acd-55ed5acb46cb" (UID: "30bac7f5-9029-4449-9acd-55ed5acb46cb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:26:17.711415 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:17.711338    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30bac7f5-9029-4449-9acd-55ed5acb46cb-openshift-service-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:26:17.711415 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:17.711366    2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30bac7f5-9029-4449-9acd-55ed5acb46cb-proxy-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 08 17:26:18.053947 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:18.053853    2583 generic.go:356] "Generic (PLEG): container finished" podID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerID="0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f" exitCode=0
Jul 08 17:26:18.053947 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:18.053897    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"
Jul 08 17:26:18.054152 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:18.053945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" event={"ID":"30bac7f5-9029-4449-9acd-55ed5acb46cb","Type":"ContainerDied","Data":"0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f"}
Jul 08 17:26:18.054152 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:18.053996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt" event={"ID":"30bac7f5-9029-4449-9acd-55ed5acb46cb","Type":"ContainerDied","Data":"7c27bd88563e38b2c967de3b56c3fc6a147940f889eefcd35da478a6cf856ee0"}
Jul 08 17:26:18.054152 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:18.054018    2583 scope.go:117] "RemoveContainer" containerID="0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f"
Jul 08 17:26:18.062370 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:18.062351    2583 scope.go:117] "RemoveContainer" containerID="0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f"
Jul 08 17:26:18.062642 ip-10-0-129-12 kubenswrapper[2583]: E0708 17:26:18.062624    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f\": container with ID starting with 0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f not found: ID does not exist" containerID="0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f"
Jul 08 17:26:18.062691 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:18.062650    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f"} err="failed to get container status \"0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f\": rpc error: code = NotFound desc = could not find container \"0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f\": container with ID starting with 0825ab5354776c0d7c2dd2fe5f8419eaf26b3a1c4591fc315c861d343a053f2f not found: ID does not exist"
Jul 08 17:26:18.073508 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:18.073481    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"]
Jul 08 17:26:18.076966 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:18.076945    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d09b9-bd8cfc589-h94lt"]
Jul 08 17:26:19.005115 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:19.005081    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" path="/var/lib/kubelet/pods/30bac7f5-9029-4449-9acd-55ed5acb46cb/volumes"
Jul 08 17:26:23.599420 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:23.599390    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mt9kk_a7b09743-c5b0-4b1e-82e3-37c9e8e09146/global-pull-secret-syncer/0.log"
Jul 08 17:26:23.757406 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:23.757340    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qwhr9_872e618a-29c3-405e-8e90-5bff364e11a4/konnectivity-agent/0.log"
Jul 08 17:26:23.812994 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:23.812967    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-12.ec2.internal_01502c7c24216826a0dc843b8111a65b/haproxy/0.log"
Jul 08 17:26:28.511974 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:28.511949    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jtbx6_91442f06-67b3-4869-aa22-b5d9f12e8b64/node-exporter/0.log"
Jul 08 17:26:28.543213 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:28.543188    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jtbx6_91442f06-67b3-4869-aa22-b5d9f12e8b64/kube-rbac-proxy/0.log"
Jul 08 17:26:28.573870 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:28.573841    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jtbx6_91442f06-67b3-4869-aa22-b5d9f12e8b64/init-textfile/0.log"
Jul 08 17:26:30.539169 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:30.539143    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-rbhsp_4323d253-8257-4561-94ff-60428ed685da/networking-console-plugin/0.log"
Jul 08 17:26:31.029668 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.029637    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/1.log"
Jul 08 17:26:31.034758 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.034736    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xvsqs_e15f68d5-4636-447e-b69f-b8a2c9a84c8f/console-operator/2.log"
Jul 08 17:26:31.543112 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.543079    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"]
Jul 08 17:26:31.543500 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.543366    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9"
Jul 08 17:26:31.543500 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.543378    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9"
Jul 08 17:26:31.543500 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.543397    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489"
Jul 08 17:26:31.543500 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.543403    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489"
Jul 08 17:26:31.543500 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.543448    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7074dee0-91c1-468c-be9f-f2bfa6ff2c18" containerName="splitter-graph-ab489"
Jul 08 17:26:31.543500 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.543481    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="30bac7f5-9029-4449-9acd-55ed5acb46cb" containerName="switch-graph-d09b9"
Jul 08 17:26:31.547855 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.547832    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.550896 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.550878    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zkvj\"/\"openshift-service-ca.crt\""
Jul 08 17:26:31.551003 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.550878    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zkvj\"/\"kube-root-ca.crt\""
Jul 08 17:26:31.551935 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.551918    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9zkvj\"/\"default-dockercfg-blrjz\""
Jul 08 17:26:31.555533 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.555512    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"]
Jul 08 17:26:31.616934 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.616903    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-lib-modules\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.617135 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.616950    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmp5l\" (UniqueName: \"kubernetes.io/projected/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-kube-api-access-gmp5l\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.617135 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.616997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-proc\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.617135 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.617035    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-podres\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.617135 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.617064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-sys\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.717426 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.717384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmp5l\" (UniqueName: \"kubernetes.io/projected/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-kube-api-access-gmp5l\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.717426 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.717421    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-proc\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.717694 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.717442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-podres\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.717694 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.717490    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-sys\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.717694 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.717509    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-proc\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.717694 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.717563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-lib-modules\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.717694 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.717565    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-sys\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.717694 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.717649    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-podres\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.717694 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.717689    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-lib-modules\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.726853 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.726821    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmp5l\" (UniqueName: \"kubernetes.io/projected/5a96eaa0-52e1-478f-985a-6a71fab4a5ed-kube-api-access-gmp5l\") pod \"perf-node-gather-daemonset-nz5vg\" (UID: \"5a96eaa0-52e1-478f-985a-6a71fab4a5ed\") " pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.858072 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.857977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:31.990197 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:31.990173    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"]
Jul 08 17:26:31.992771 ip-10-0-129-12 kubenswrapper[2583]: W0708 17:26:31.992742    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5a96eaa0_52e1_478f_985a_6a71fab4a5ed.slice/crio-160b318fa0f03cf436f288eb5f4bcb3a34b2116fc867fb3f5e8458731827ee1c WatchSource:0}: Error finding container 160b318fa0f03cf436f288eb5f4bcb3a34b2116fc867fb3f5e8458731827ee1c: Status 404 returned error can't find the container with id 160b318fa0f03cf436f288eb5f4bcb3a34b2116fc867fb3f5e8458731827ee1c
Jul 08 17:26:32.107267 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:32.107233    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg" event={"ID":"5a96eaa0-52e1-478f-985a-6a71fab4a5ed","Type":"ContainerStarted","Data":"6561af0193937c2d41bfab39bba69140e4734d3482ab01b08097f4d66ea94f27"}
Jul 08 17:26:32.107444 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:32.107296    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg" event={"ID":"5a96eaa0-52e1-478f-985a-6a71fab4a5ed","Type":"ContainerStarted","Data":"160b318fa0f03cf436f288eb5f4bcb3a34b2116fc867fb3f5e8458731827ee1c"}
Jul 08 17:26:32.107444 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:32.107404    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:32.122926 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:32.122806    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg" podStartSLOduration=1.122789365 podStartE2EDuration="1.122789365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:32.122035236 +0000 UTC m=+3149.666388388" watchObservedRunningTime="2026-07-08 17:26:32.122789365 +0000 UTC m=+3149.667142516"
Jul 08 17:26:32.123563 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:32.123545    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-tkc4g_3a6f4b42-512a-424d-9aca-b2717225a405/volume-data-source-validator/0.log"
Jul 08 17:26:33.107216 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:33.107186    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgpdv_2b8a2df0-53f6-4d0f-89f5-5b5572ed9384/dns/0.log"
Jul 08 17:26:33.130352 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:33.130326    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pgpdv_2b8a2df0-53f6-4d0f-89f5-5b5572ed9384/kube-rbac-proxy/0.log"
Jul 08 17:26:33.207585 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:33.207560    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pkbl5_85e37108-b3e5-43a9-803f-a409ced780e4/dns-node-resolver/0.log"
Jul 08 17:26:33.819134 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:33.819105    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2tlm_3ba94bac-d099-4adc-9ba5-fcaf01ee5f74/node-ca/0.log"
Jul 08 17:26:34.998780 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:34.998747    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kxnpg_0d90ba13-50da-4fc8-a242-3d2b776fb911/serve-healthcheck-canary/0.log"
Jul 08 17:26:35.485964 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:35.485936    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8t88b_9dde7f15-6243-4f8c-af58-7860929b35c5/kube-rbac-proxy/0.log"
Jul 08 17:26:35.509901 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:35.509879    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8t88b_9dde7f15-6243-4f8c-af58-7860929b35c5/exporter/0.log"
Jul 08 17:26:35.533390 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:35.533370    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8t88b_9dde7f15-6243-4f8c-af58-7860929b35c5/extractor/0.log"
Jul 08 17:26:37.625595 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:37.625563    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-84fc959947-rgslh_3af74196-8d7a-44bd-b648-6d5e12f5a5a4/manager/0.log"
Jul 08 17:26:38.121703 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:38.121671    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9zkvj/perf-node-gather-daemonset-nz5vg"
Jul 08 17:26:42.589384 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:42.589345    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-psq6v_e145071b-da47-4529-8166-af9fce467d01/kube-storage-version-migrator-operator/1.log"
Jul 08 17:26:42.590148 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:42.590130    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-psq6v_e145071b-da47-4529-8166-af9fce467d01/kube-storage-version-migrator-operator/0.log"
Jul 08 17:26:43.552196 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:43.552169    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8m7pv_2165d4c2-a77d-4b76-b474-95315fb06fd7/kube-multus/0.log"
Jul 08 17:26:43.932948 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:43.932921    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9n4x_56996789-2cf7-4141-9898-ecd9eef72b7e/kube-multus-additional-cni-plugins/0.log"
Jul 08 17:26:43.955936 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:43.955911    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9n4x_56996789-2cf7-4141-9898-ecd9eef72b7e/egress-router-binary-copy/0.log"
Jul 08 17:26:43.981768 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:43.981742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9n4x_56996789-2cf7-4141-9898-ecd9eef72b7e/cni-plugins/0.log"
Jul 08 17:26:44.013400 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:44.013369    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9n4x_56996789-2cf7-4141-9898-ecd9eef72b7e/bond-cni-plugin/0.log"
Jul 08 17:26:44.037179 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:44.037150    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9n4x_56996789-2cf7-4141-9898-ecd9eef72b7e/routeoverride-cni/0.log"
Jul 08 17:26:44.059623 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:44.059595    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9n4x_56996789-2cf7-4141-9898-ecd9eef72b7e/whereabouts-cni-bincopy/0.log"
Jul 08 17:26:44.083467 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:44.083415    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9n4x_56996789-2cf7-4141-9898-ecd9eef72b7e/whereabouts-cni/0.log"
Jul 08 17:26:44.300014 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:44.299943    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bmrdj_e1dfe72b-45e2-4611-afd4-f5a04fe89fbc/network-metrics-daemon/0.log"
Jul 08 17:26:44.322776 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:44.322751    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bmrdj_e1dfe72b-45e2-4611-afd4-f5a04fe89fbc/kube-rbac-proxy/0.log"
Jul 08 17:26:45.095966 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:45.095943    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-controller/0.log"
Jul 08 17:26:45.115610 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:45.115568    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/0.log"
Jul 08 17:26:45.115769 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:45.115618    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovn-acl-logging/1.log"
Jul 08 17:26:45.145569 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:45.145542    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/kube-rbac-proxy-node/0.log"
Jul 08 17:26:45.169776 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:45.169752    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/kube-rbac-proxy-ovn-metrics/0.log"
Jul 08 17:26:45.193721 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:45.193693    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/northd/0.log"
Jul 08 17:26:45.216532 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:45.216508    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/nbdb/0.log"
Jul 08 17:26:45.243332 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:45.243304    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/sbdb/0.log"
Jul 08 17:26:45.292142 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:45.292112    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6db6r_a6a36d7e-2412-4a90-9cf8-4713b45ac268/ovnkube-controller/0.log"
Jul 08 17:26:46.754677 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:46.754644    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-zh6r7_d46e2dd2-8dd6-43bb-b8ed-5f163e5c8af8/check-endpoints/0.log"
Jul 08 17:26:46.778980 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:46.778951    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6ltj4_30ac66b0-607c-4ed9-bdb7-79065051bbb0/network-check-target-container/0.log"
Jul 08 17:26:47.952584 ip-10-0-129-12 kubenswrapper[2583]: I0708 17:26:47.952555    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wjh28_cd7393d7-c4dd-40de-b68e-f8e154affeb7/iptables-alerter/0.log"