Jul 29 17:34:30.544878 ip-10-0-133-94 systemd[1]: Starting Kubernetes Kubelet... Jul 29 17:34:30.955259 ip-10-0-133-94 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 17:34:30.955259 ip-10-0-133-94 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 17:34:30.955259 ip-10-0-133-94 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 17:34:30.955259 ip-10-0-133-94 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 17:34:30.955259 ip-10-0-133-94 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 17:34:30.957067 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.956968 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 17:34:30.962381 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962356 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:30.962381 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962380 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:30.962381 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962384 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962389 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962392 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962395 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962397 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962400 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962403 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962406 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962408 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962411 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962413 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962416 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962419 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962422 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962424 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962427 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962433 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962435 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962438 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962445 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:30.962485 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962448 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962450 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962453 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962456 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962459 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962461 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962464 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962467 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962469 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962471 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962474 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962476 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962479 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962482 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962484 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962487 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962490 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962493 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962496 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:30.962973 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962499 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962502 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962504 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962507 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962509 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962512 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962514 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962517 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962519 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962522 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962524 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962527 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962529 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962533 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962537 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962541 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962544 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962548 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962568 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962572 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:30.963431 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962577 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962581 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962585 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962589 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962597 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962604 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962608 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962610 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962613 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962616 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962619 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962622 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962625 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962628 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962630 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962634 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962636 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962639 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962641 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:30.963967 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962645 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962649 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962653 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962656 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962659 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962662 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962665 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962669 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962671 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962675 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962677 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962680 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962682 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962686 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962688 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962691 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962693 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962696 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.962699 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:30.964433 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964171 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964180 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964184 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964187 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964190 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964193 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964195 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964198 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964201 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964203 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964206 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964208 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964211 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964214 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964216 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964219 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964221 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964224 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964226 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964229 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:30.964929 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964231 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964235 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964237 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964240 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964243 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964245 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964248 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964251 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964253 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964255 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964258 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964261 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964264 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964266 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964269 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964271 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964273 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964276 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964279 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:30.965420 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964281 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964284 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964287 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964289 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964292 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964294 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964297 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964299 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964303 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964305 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964311 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964314 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964317 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964319 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964321 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964327 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964330 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964333 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964335 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964338 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:30.965943 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964340 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964343 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964345 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964348 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964351 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964354 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964357 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964359 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964362 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964366 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964370 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964374 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964377 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964380 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964383 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964385 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964388 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964390 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964393 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:30.966436 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964397 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964399 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964402 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964405 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964408 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964411 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964413 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964416 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964418 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964427 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964429 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964432 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964435 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964437 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964440 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964443 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964445 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964449 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964451 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:30.967204 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964455 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964458 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964920 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964926 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964929 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964932 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964935 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964938 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964941 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964944 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964946 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964949 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964952 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964954 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964957 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964959 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964963 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964966 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964968 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964971 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:30.967782 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964974 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964976 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964980 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964983 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964985 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964988 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964990 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964993 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964995 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.964998 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965000 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965003 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965006 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965008 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965010 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965015 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965019 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965022 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965024 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:30.968308 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965028 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965032 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965036 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965039 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965042 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965044 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965047 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965050 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965053 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965056 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965058 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965061 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965064 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965066 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965069 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965071 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965074 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965077 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965079 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965083 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:30.968809 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965086 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965088 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965091 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965093 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965096 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965098 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965101 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965103 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965106 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965108 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965111 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965113 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965116 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965118 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965120 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965123 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965126 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965128 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965130 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965133 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:30.969289 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965135 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965138 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965140 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965143 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965145 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965148 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965150 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965153 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965155 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965166 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965169 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965171 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965174 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965177 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965180 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965182 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965185 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965187 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965190 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:30.969793 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965192 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965195 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965198 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965279 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965287 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965294 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965299 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965304 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965308 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965312 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965317 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965320 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965323 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965327 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965330 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965333 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965336 2560 flags.go:64] FLAG: --cgroup-root="" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965339 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965343 2560 flags.go:64] FLAG: --client-ca-file="" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965346 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965350 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965354 2560 flags.go:64] FLAG: --cluster-domain="" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965357 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 17:34:30.970256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965361 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965364 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965368 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965371 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965375 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965378 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965381 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965384 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965387 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965390 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965394 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965397 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965401 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965404 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965408 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965411 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965417 2560 flags.go:64] FLAG: --enable-server="true" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965420 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965425 2560 flags.go:64] FLAG: --event-burst="100" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965429 2560 flags.go:64] FLAG: --event-qps="50" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965432 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965435 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965438 2560 flags.go:64] FLAG: --eviction-hard="" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965442 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 17:34:30.970824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965445 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965448 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965451 2560 flags.go:64] FLAG: --eviction-soft="" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965454 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965457 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965463 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965466 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965469 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965472 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965476 2560 flags.go:64] FLAG: --feature-gates="" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965480 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965483 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965486 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965489 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965492 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965495 2560 flags.go:64] FLAG: --help="false" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965498 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-133-94.ec2.internal" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965501 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965504 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965508 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965511 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965514 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965517 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 17:34:30.971396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965520 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965524 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965528 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965531 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965534 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965537 2560 flags.go:64] FLAG: --kube-reserved="" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965540 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965543 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965546 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965548 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965566 2560 flags.go:64] FLAG: --lock-file="" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965571 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965575 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965580 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965590 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965593 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965596 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965599 2560 flags.go:64] FLAG: --logging-format="text" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965602 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965606 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965610 2560 flags.go:64] FLAG: --manifest-url="" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965613 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965617 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965621 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965625 2560 flags.go:64] FLAG: --max-pods="110" Jul 29 17:34:30.971992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965628 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965631 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965634 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965637 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965640 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965643 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965646 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965654 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965658 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965661 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965664 2560 flags.go:64] FLAG: --pod-cidr="" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965668 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965677 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965681 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965684 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965687 2560 flags.go:64] FLAG: --port="10250" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965690 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965693 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07d3216cfab166877" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965696 2560 flags.go:64] FLAG: --qos-reserved="" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965699 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965702 2560 flags.go:64] FLAG: --register-node="true" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965705 2560 flags.go:64] FLAG: --register-with-taints="" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965710 2560 flags.go:64] FLAG: --registry-burst="10" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965713 2560 flags.go:64] FLAG: --registry-qps="5" Jul 29 17:34:30.972619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965716 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965719 2560 flags.go:64] FLAG: --reserved-memory="" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965723 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965726 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965729 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965732 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965735 2560 flags.go:64] FLAG: --runonce="false" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965738 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965741 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965744 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965747 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965750 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965753 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965756 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965759 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965762 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965766 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965769 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965773 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965776 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965779 2560 flags.go:64] FLAG: --system-cgroups="" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965782 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965788 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965791 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965794 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 17:34:30.973361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965798 2560 flags.go:64] FLAG: --tls-min-version="" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965801 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965804 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965807 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965809 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965814 2560 flags.go:64] FLAG: --v="2" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965818 2560 flags.go:64] FLAG: --version="false" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965823 2560 flags.go:64] FLAG: --vmodule="" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965827 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.965830 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965970 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965974 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965978 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965980 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965983 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965986 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965988 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965991 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965995 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.965999 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966002 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:30.974435 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966004 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966007 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966012 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966015 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966017 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966020 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966023 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966025 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966028 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966032 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966035 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966038 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966041 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966044 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966047 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966050 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966054 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966057 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966060 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966062 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:30.975331 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966065 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966067 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966070 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966073 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966076 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966078 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966081 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966083 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966103 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966107 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966110 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966113 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966116 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966118 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966123 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966125 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966128 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966130 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966133 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966136 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:30.975986 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966138 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966141 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966144 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966146 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966149 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966151 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966154 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966156 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966160 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966163 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966165 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966168 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966171 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966173 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966175 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966178 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966181 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966184 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966187 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966190 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:30.976860 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966192 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966195 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966197 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966200 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966202 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966205 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966209 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966211 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966214 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966216 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966219 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966221 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966224 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966226 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966229 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966231 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966234 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966236 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966239 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966243 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:30.977718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966247 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966251 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966254 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966256 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966259 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966262 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966264 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.966267 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.966272 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.975362 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.975388 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.976100 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.976117 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976223 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:30.978283 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976231 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976239 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976245 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976250 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976257 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976264 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976269 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976274 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976279 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976284 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976288 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976293 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976297 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976301 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976307 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976311 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976316 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976320 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976324 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976328 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:30.978911 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976333 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976337 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976341 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976345 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976349 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976354 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976358 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976363 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976368 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976372 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976377 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976383 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976389 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976393 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976397 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976402 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976406 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976410 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976414 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:30.979900 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976418 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976422 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976426 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976430 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976434 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976439 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976445 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976449 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976453 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976457 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976461 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976465 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976469 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976473 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976477 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976482 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976486 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976490 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976494 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976498 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:30.980491 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976502 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976507 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976512 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976516 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976520 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976525 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976529 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976533 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976537 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976541 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976545 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976549 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976571 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976576 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976580 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976585 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976589 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976592 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976597 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976602 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:30.981038 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976606 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976611 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976615 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976619 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976623 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976627 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976632 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976636 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976640 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976644 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976648 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976652 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976656 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976663 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976669 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976673 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976678 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976683 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:30.981573 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976688 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.976697 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976892 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976902 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976907 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976912 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976917 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976921 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976926 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976930 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976934 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976938 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976943 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976947 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976953 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976958 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 17:34:30.982068 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976962 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976966 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976973 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976979 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976984 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976989 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.976994 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977000 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977006 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977010 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977015 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977020 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977025 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977030 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977034 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977039 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977043 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977047 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977052 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 17:34:30.982507 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977056 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977060 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977064 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977068 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977072 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977076 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977081 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977087 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977091 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977095 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977099 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977104 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977109 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977113 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977117 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977122 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977126 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977131 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977135 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 17:34:30.983022 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977139 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977143 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977147 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977151 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977156 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977160 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977164 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977168 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977173 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977177 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977181 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977185 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977190 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977194 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977198 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977202 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977207 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977211 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977215 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977219 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 17:34:30.983593 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977223 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977227 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977231 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977235 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977239 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977243 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977248 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977252 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977257 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977261 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977265 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977269 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977273 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977277 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977281 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977285 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977289 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977293 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977297 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977301 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 17:34:30.984407 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977307 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977311 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977315 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977320 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977325 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977329 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:30.977334 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.977342 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.977533 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.980279 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.981647 2560 server.go:1019] "Starting client certificate rotation" Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.981760 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.981833 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 17:34:30.985230 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.984163 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 17:34:30.986040 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:30.986014 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 17:34:31.000737 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.000663 2560 log.go:25] "Validated CRI v1 runtime API" Jul 29 17:34:31.004083 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.004060 2560 log.go:25] "Validated CRI v1 image API" Jul 29 17:34:31.005002 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.004973 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 17:34:31.011741 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.011681 2560 fs.go:135] Filesystem UUIDs: map[756a5ca6-2158-4b50-8090-7a62ac2f082b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cb9d364b-4543-4b91-bf25-514113dc3975:/dev/nvme0n1p3] Jul 29 17:34:31.011741 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.011728 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 17:34:31.014728 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.014705 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 17:34:31.017747 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.017628 2560 manager.go:216] Machine: {Timestamp:2026-07-29 17:34:31.015536431 +0000 UTC m=+0.348172170 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099817 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25445b9fa00771a6042c64d9a954d4 SystemUUID:ec25445b-9fa0-0771-a604-2c64d9a954d4 BootID:c57d58bb-2dde-437c-a06b-93c75919d4b1 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ec:e8:8f:5e:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ec:e8:8f:5e:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:78:09:71:c9:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 17:34:31.017747 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.017742 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 17:34:31.017858 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.017843 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 17:34:31.018715 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.018684 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 17:34:31.018871 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.018718 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-94.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 17:34:31.019759 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.019749 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 17:34:31.019797 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.019762 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 17:34:31.019797 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.019770 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 17:34:31.020361 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.020350 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 17:34:31.020997 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.020987 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 17:34:31.022604 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.022592 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 29 17:34:31.022745 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.022735 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 17:34:31.022778 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.022772 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 29 17:34:31.022804 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.022795 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 17:34:31.022831 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.022819 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 17:34:31.022857 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.022834 2560 kubelet.go:398] "Adding apiserver pod source" Jul 29 17:34:31.022857 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.022848 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 17:34:31.023388 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.023367 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 17:34:31.023459 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.023394 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 17:34:31.026113 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.026093 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 17:34:31.027866 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.027853 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 17:34:31.027910 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.027884 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 17:34:31.030001 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.029987 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 17:34:31.030051 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030008 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 17:34:31.030051 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030016 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 17:34:31.030051 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030023 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 17:34:31.030051 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030035 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 17:34:31.030051 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030046 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 17:34:31.030189 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030057 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 17:34:31.030189 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030065 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 17:34:31.030189 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030074 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 17:34:31.030189 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030080 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 17:34:31.030189 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030099 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 17:34:31.030189 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030105 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 17:34:31.030659 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030649 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 17:34:31.030691 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.030660 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 17:34:31.032344 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.032319 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 17:34:31.032437 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.032420 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-94.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 17:34:31.032607 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.032582 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 17:34:31.034149 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.034137 2560 server.go:1268] "Started kubelet" Jul 29 17:34:31.034230 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.034198 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 17:34:31.034289 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.034221 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 17:34:31.034335 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.034297 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 17:34:31.035007 ip-10-0-133-94 systemd[1]: Started Kubernetes Kubelet. Jul 29 17:34:31.035704 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.035569 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 17:34:31.035704 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.035589 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 29 17:34:31.040544 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.040506 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 17:34:31.042981 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.041155 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-94.ec2.internal.18c6d327fefc31c6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-94.ec2.internal,UID:ip-10-0-133-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-94.ec2.internal,},FirstTimestamp:2026-07-29 17:34:31.03410631 +0000 UTC m=+0.366742027,LastTimestamp:2026-07-29 17:34:31.03410631 +0000 UTC m=+0.366742027,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-94.ec2.internal,}" Jul 29 17:34:31.045943 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.045913 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 17:34:31.045943 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.045923 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 17:34:31.046088 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.046027 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.047135 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047006 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 17:34:31.047135 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047020 2560 factory.go:55] Registering systemd factory Jul 29 17:34:31.047135 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047030 2560 factory.go:223] Registration of the systemd container factory successfully Jul 29 17:34:31.047416 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047302 2560 factory.go:153] Registering CRI-O factory Jul 29 17:34:31.047416 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047313 2560 factory.go:223] Registration of the crio container factory successfully Jul 29 17:34:31.047416 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047337 2560 factory.go:103] Registering Raw factory Jul 29 17:34:31.047416 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047350 2560 manager.go:1196] Started watching for new ooms in manager Jul 29 17:34:31.047607 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047574 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 17:34:31.047607 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047593 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 17:34:31.047708 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047577 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 17:34:31.047757 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047733 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 29 17:34:31.047757 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047740 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 29 17:34:31.047863 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.047846 2560 manager.go:349] Starting recovery of all containers Jul 29 17:34:31.056835 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.056804 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 17:34:31.056978 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.056912 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 17:34:31.057203 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.057102 2560 manager.go:354] Recovery completed Jul 29 17:34:31.061203 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.061187 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:31.063092 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.063068 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:31.063155 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.063112 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:31.063155 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.063123 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:31.063681 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.063662 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 17:34:31.063681 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.063679 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 17:34:31.063792 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.063699 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 29 17:34:31.063792 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.063673 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:31.064398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.064384 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:31.064442 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.064411 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:31.064442 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.064421 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:31.065649 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.065636 2560 policy_none.go:49] "None policy: Start" Jul 29 17:34:31.065706 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.065652 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 17:34:31.065706 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.065662 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 17:34:31.066619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.066609 2560 policy_none.go:47] "Start" Jul 29 17:34:31.073185 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.073104 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-94.ec2.internal.18c6d32800b67f2a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-94.ec2.internal,UID:ip-10-0-133-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-94.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-94.ec2.internal,},FirstTimestamp:2026-07-29 17:34:31.063093034 +0000 UTC m=+0.395728766,LastTimestamp:2026-07-29 17:34:31.063093034 +0000 UTC m=+0.395728766,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-94.ec2.internal,}" Jul 29 17:34:31.083881 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.083755 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-94.ec2.internal.18c6d32800b6df35 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-94.ec2.internal,UID:ip-10-0-133-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-94.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-94.ec2.internal,},FirstTimestamp:2026-07-29 17:34:31.063117621 +0000 UTC m=+0.395753342,LastTimestamp:2026-07-29 17:34:31.063117621 +0000 UTC m=+0.395753342,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-94.ec2.internal,}" Jul 29 17:34:31.094750 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.094536 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-94.ec2.internal.18c6d32800b70537 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-94.ec2.internal,UID:ip-10-0-133-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-94.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-94.ec2.internal,},FirstTimestamp:2026-07-29 17:34:31.063127351 +0000 UTC m=+0.395763068,LastTimestamp:2026-07-29 17:34:31.063127351 +0000 UTC m=+0.395763068,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-94.ec2.internal,}" Jul 29 17:34:31.104549 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.104528 2560 manager.go:337] "Starting Device Plugin manager" Jul 29 17:34:31.104719 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.104586 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 17:34:31.104719 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.104597 2560 server.go:87] "Starting device plugin registration server" Jul 29 17:34:31.104885 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.104871 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 17:34:31.104917 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.104889 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 17:34:31.104997 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.104975 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 17:34:31.105098 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.105072 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 17:34:31.105098 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.105082 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 17:34:31.105724 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.105705 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 17:34:31.105812 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.105759 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.106158 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.106091 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-94.ec2.internal.18c6d32800b67f2a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-94.ec2.internal.18c6d32800b67f2a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-94.ec2.internal,UID:ip-10-0-133-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-94.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-94.ec2.internal,},FirstTimestamp:2026-07-29 17:34:31.063093034 +0000 UTC m=+0.395728766,LastTimestamp:2026-07-29 17:34:31.064397391 +0000 UTC m=+0.397033109,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-94.ec2.internal,}" Jul 29 17:34:31.118573 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.118479 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-94.ec2.internal.18c6d32800b6df35\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-94.ec2.internal.18c6d32800b6df35 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-94.ec2.internal,UID:ip-10-0-133-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-94.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-94.ec2.internal,},FirstTimestamp:2026-07-29 17:34:31.063117621 +0000 UTC m=+0.395753342,LastTimestamp:2026-07-29 17:34:31.064416363 +0000 UTC m=+0.397052080,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-94.ec2.internal,}" Jul 29 17:34:31.121711 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.121688 2560 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2594 into the system container \"/system.slice\": " Jul 29 17:34:31.126159 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.126079 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-94.ec2.internal.18c6d32800b70537\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-94.ec2.internal.18c6d32800b70537 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-94.ec2.internal,UID:ip-10-0-133-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-94.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-94.ec2.internal,},FirstTimestamp:2026-07-29 17:34:31.063127351 +0000 UTC m=+0.395763068,LastTimestamp:2026-07-29 17:34:31.064425444 +0000 UTC m=+0.397061162,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-94.ec2.internal,}" Jul 29 17:34:31.127180 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.127161 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7s6w7" Jul 29 17:34:31.135103 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.135020 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-94.ec2.internal.18c6d3280352fbf1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-94.ec2.internal,UID:ip-10-0-133-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-133-94.ec2.internal,},FirstTimestamp:2026-07-29 17:34:31.106903025 +0000 UTC m=+0.439538729,LastTimestamp:2026-07-29 17:34:31.106903025 +0000 UTC m=+0.439538729,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-94.ec2.internal,}" Jul 29 17:34:31.147741 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.135135 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7s6w7" Jul 29 17:34:31.190314 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.190275 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 17:34:31.191733 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.191712 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 17:34:31.191799 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.191764 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 17:34:31.191799 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.191791 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 17:34:31.191874 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.191836 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 17:34:31.200324 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.200301 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:31.205165 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.205148 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:31.206219 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.206144 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:31.206219 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.206179 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:31.206219 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.206194 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:31.206420 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.206245 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.218238 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.218211 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.218238 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.218240 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-94.ec2.internal\": node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.244892 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.244857 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.293393 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.292687 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal"] Jul 29 17:34:31.293588 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.293438 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:31.294505 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.294482 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:31.294637 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.294517 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:31.294637 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.294536 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:31.295851 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.295838 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:31.295970 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.295956 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.296017 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.295988 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:31.296720 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.296707 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:31.296720 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.296715 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:31.296833 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.296732 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:31.296833 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.296739 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:31.296833 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.296742 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:31.296833 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.296749 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:31.297918 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.297905 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.297964 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.297931 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 17:34:31.301605 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.301588 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientMemory" Jul 29 17:34:31.301694 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.301624 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 17:34:31.301694 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.301638 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeHasSufficientPID" Jul 29 17:34:31.318471 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.318437 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-94.ec2.internal\" not found" node="ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.323171 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.323154 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-94.ec2.internal\" not found" node="ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.345982 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.345956 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.349078 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.349057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d3f6cec1d9e701948f13a49a64d6383-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal\" (UID: \"9d3f6cec1d9e701948f13a49a64d6383\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.349177 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.349088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/32ce9ec9d7e6ed8fb9a0a2b24a14d2ec-config\") pod \"kube-apiserver-proxy-ip-10-0-133-94.ec2.internal\" (UID: \"32ce9ec9d7e6ed8fb9a0a2b24a14d2ec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.349177 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.349115 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d3f6cec1d9e701948f13a49a64d6383-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal\" (UID: \"9d3f6cec1d9e701948f13a49a64d6383\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.446925 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.446883 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.450141 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.450121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d3f6cec1d9e701948f13a49a64d6383-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal\" (UID: \"9d3f6cec1d9e701948f13a49a64d6383\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.450204 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.450151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d3f6cec1d9e701948f13a49a64d6383-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal\" (UID: \"9d3f6cec1d9e701948f13a49a64d6383\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.450204 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.450167 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/32ce9ec9d7e6ed8fb9a0a2b24a14d2ec-config\") pod \"kube-apiserver-proxy-ip-10-0-133-94.ec2.internal\" (UID: \"32ce9ec9d7e6ed8fb9a0a2b24a14d2ec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.450279 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.450219 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/32ce9ec9d7e6ed8fb9a0a2b24a14d2ec-config\") pod \"kube-apiserver-proxy-ip-10-0-133-94.ec2.internal\" (UID: \"32ce9ec9d7e6ed8fb9a0a2b24a14d2ec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.450279 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.450228 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d3f6cec1d9e701948f13a49a64d6383-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal\" (UID: \"9d3f6cec1d9e701948f13a49a64d6383\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.450279 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.450255 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d3f6cec1d9e701948f13a49a64d6383-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal\" (UID: \"9d3f6cec1d9e701948f13a49a64d6383\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.547769 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.547703 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.621078 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.621046 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.625915 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.625890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal" Jul 29 17:34:31.648042 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.648007 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.748606 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.748546 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.849139 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.849059 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.949729 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:31.949680 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:31.981041 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.981007 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 17:34:31.981480 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:31.981162 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 17:34:32.049791 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:32.049755 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-94.ec2.internal\" not found" Jul 29 17:34:32.110807 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.110734 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:32.140717 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.140675 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 17:29:32 +0000 UTC" deadline="2028-03-20 21:54:21.931326388 +0000 UTC" Jul 29 17:34:32.140717 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.140712 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14404h19m49.790617986s" Jul 29 17:34:32.146854 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.146826 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" Jul 29 17:34:32.165990 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.165958 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 17:34:32.167300 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.167280 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal" Jul 29 17:34:32.177204 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.177179 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 17:34:32.190226 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:32.190192 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3f6cec1d9e701948f13a49a64d6383.slice/crio-03dbe9586a7d8ff1253f25dfa1fd17cb2eb45a54e225fd9007a24515661c7bf4 WatchSource:0}: Error finding container 03dbe9586a7d8ff1253f25dfa1fd17cb2eb45a54e225fd9007a24515661c7bf4: Status 404 returned error can't find the container with id 03dbe9586a7d8ff1253f25dfa1fd17cb2eb45a54e225fd9007a24515661c7bf4 Jul 29 17:34:32.190576 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:32.190529 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ce9ec9d7e6ed8fb9a0a2b24a14d2ec.slice/crio-aeea8ec6181a9e15e00035385616a306a6a793fbdd0f6f49a8d7107966b031b5 WatchSource:0}: Error finding container aeea8ec6181a9e15e00035385616a306a6a793fbdd0f6f49a8d7107966b031b5: Status 404 returned error can't find the container with id aeea8ec6181a9e15e00035385616a306a6a793fbdd0f6f49a8d7107966b031b5 Jul 29 17:34:32.196074 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.196054 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:34:32.197639 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.197589 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal" event={"ID":"32ce9ec9d7e6ed8fb9a0a2b24a14d2ec","Type":"ContainerStarted","Data":"aeea8ec6181a9e15e00035385616a306a6a793fbdd0f6f49a8d7107966b031b5"} Jul 29 17:34:32.198608 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.198586 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" event={"ID":"9d3f6cec1d9e701948f13a49a64d6383","Type":"ContainerStarted","Data":"03dbe9586a7d8ff1253f25dfa1fd17cb2eb45a54e225fd9007a24515661c7bf4"} Jul 29 17:34:32.356866 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.355974 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:32.555604 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:32.555576 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:34.315337 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.315289 2560 apiserver.go:52] "Watching apiserver" Jul 29 17:34:34.321571 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.321230 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 17:34:34.322220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.322190 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2","openshift-cluster-node-tuning-operator/tuned-lg2jd","openshift-dns/node-resolver-s66k8","openshift-image-registry/node-ca-j9sg2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal","openshift-multus/multus-bstl2","kube-system/global-pull-secret-syncer-nk54l","openshift-multus/multus-additional-cni-plugins-8dxl6","openshift-multus/network-metrics-daemon-2rvxq","openshift-network-diagnostics/network-check-target-hxnr6","openshift-network-operator/iptables-alerter-7c5pz","openshift-ovn-kubernetes/ovnkube-node-l5jjx","kube-system/konnectivity-agent-qcwb6"] Jul 29 17:34:34.323872 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.323850 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.325504 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.325486 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.326812 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.326999 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.327208 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.327438 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ct5vn\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.327616 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.329317 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.329514 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.329817 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.330006 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.330397 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.330613 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mvfw7\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.330825 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.330911 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.331011 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.331661 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.331669 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.332000 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.333407 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.333507 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:34.334396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.333845 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.335392 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.335482 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.336128 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.336547 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.336646 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.336787 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j8fbw\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.336859 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t6glz\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.337051 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.337061 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.337412 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.337417 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wx79t\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.337678 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.337814 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4x6ht\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.337850 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.337942 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.338031 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.338161 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.338206 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.338364 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.338560 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.338744 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sf28\"" Jul 29 17:34:34.339081 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.338921 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 17:34:34.340633 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.339717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:34.340633 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.339770 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:34.340633 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.340496 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 17:34:34.340825 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.340634 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2m5c2\"" Jul 29 17:34:34.342063 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.341849 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 17:34:34.342063 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.341888 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:34:34.342063 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.342000 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tcqh2\"" Jul 29 17:34:34.342295 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.342204 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 17:34:34.342295 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.342253 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 17:34:34.351206 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:34.351350 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-cnibin\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.351418 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-slash\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.351491 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-log-socket\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.351541 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/447cc5fa-a004-4b09-a0e0-d59b95fa9262-env-overrides\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.351589 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351536 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44e17049-7d2e-490f-8a4e-c45a4fb28206-iptables-alerter-script\") pod \"iptables-alerter-7c5pz\" (UID: \"44e17049-7d2e-490f-8a4e-c45a4fb28206\") " pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.351638 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-run-k8s-cni-cncf-io\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.351689 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-os-release\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.351736 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-kubelet-config\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.352244 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.351798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-system-cni-dir\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.352244 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-cni-dir\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.352244 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-run-systemd\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.352244 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352230 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-run-ovn-kubernetes\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.352535 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352265 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-cni-bin\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.352535 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352297 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/447cc5fa-a004-4b09-a0e0-d59b95fa9262-ovn-node-metrics-cert\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.352535 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352380 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.352535 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352467 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-modprobe-d\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.352535 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdc5063b-6410-4dfe-86c0-a42e4e10b60d-konnectivity-ca\") pod \"konnectivity-agent-qcwb6\" (UID: \"cdc5063b-6410-4dfe-86c0-a42e4e10b60d\") " pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:34:34.352789 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.352789 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.352758 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 17:34:34.353029 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-run-openvswitch\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.353118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353080 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d54bc7ed-6203-453b-81e7-8e0170ffa718-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.353168 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-sysconfig\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.353209 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353184 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-socket-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.353254 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353212 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgjrz\" (UniqueName: \"kubernetes.io/projected/b057caf9-7108-4aac-baff-254996f04872-kube-api-access-fgjrz\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.353254 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353236 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-kubelet\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.353397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-run-ovn\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.353397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-etc-selinux\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.353397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e17049-7d2e-490f-8a4e-c45a4fb28206-host-slash\") pod \"iptables-alerter-7c5pz\" (UID: \"44e17049-7d2e-490f-8a4e-c45a4fb28206\") " pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.353535 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353407 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-var-lib-cni-bin\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.353535 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdc5063b-6410-4dfe-86c0-a42e4e10b60d-agent-certs\") pod \"konnectivity-agent-qcwb6\" (UID: \"cdc5063b-6410-4dfe-86c0-a42e4e10b60d\") " pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:34:34.353535 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-conf-dir\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.353679 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23725b74-f8de-4145-85bc-574758306a84-host\") pod \"node-ca-j9sg2\" (UID: \"23725b74-f8de-4145-85bc-574758306a84\") " pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.354421 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d54bc7ed-6203-453b-81e7-8e0170ffa718-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.354421 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.353771 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:34.354421 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.354002 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-sys-fs\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.354421 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.354221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdnq6\" (UniqueName: \"kubernetes.io/projected/638db2e6-2136-4236-b37b-49b391776c7f-kube-api-access-tdnq6\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:34.354421 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.354253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-var-lib-cni-multus\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.355136 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.354958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rbj\" (UniqueName: \"kubernetes.io/projected/23725b74-f8de-4145-85bc-574758306a84-kube-api-access-86rbj\") pod \"node-ca-j9sg2\" (UID: \"23725b74-f8de-4145-85bc-574758306a84\") " pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.355336 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355281 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-sys\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.355721 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355700 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-host\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.355805 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-socket-dir-parent\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.355805 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355760 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-run-netns\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.355805 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-run-multus-certs\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.355955 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355809 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/447cc5fa-a004-4b09-a0e0-d59b95fa9262-ovnkube-script-lib\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.355955 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355833 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d3beb8a-488b-441f-b7d4-01ce783ad5d5-tmp-dir\") pod \"node-resolver-s66k8\" (UID: \"1d3beb8a-488b-441f-b7d4-01ce783ad5d5\") " pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.355955 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88fnw\" (UniqueName: \"kubernetes.io/projected/1d3beb8a-488b-441f-b7d4-01ce783ad5d5-kube-api-access-88fnw\") pod \"node-resolver-s66k8\" (UID: \"1d3beb8a-488b-441f-b7d4-01ce783ad5d5\") " pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.355955 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355882 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-dbus\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.355955 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355915 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-kubernetes\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.355955 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-os-release\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml5mh\" (UniqueName: \"kubernetes.io/projected/2edba168-5b26-42e4-a3c3-db9d380468c0-kube-api-access-ml5mh\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.355982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-etc-openvswitch\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d54bc7ed-6203-453b-81e7-8e0170ffa718-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txpc2\" (UniqueName: \"kubernetes.io/projected/d54bc7ed-6203-453b-81e7-8e0170ffa718-kube-api-access-txpc2\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356061 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-sysctl-d\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-run-netns\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-node-log\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-system-cni-dir\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356156 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-device-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.356226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356198 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94q7k\" (UniqueName: \"kubernetes.io/projected/44e17049-7d2e-490f-8a4e-c45a4fb28206-kube-api-access-94q7k\") pod \"iptables-alerter-7c5pz\" (UID: \"44e17049-7d2e-490f-8a4e-c45a4fb28206\") " pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-hostroot\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356259 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7fn9\" (UniqueName: \"kubernetes.io/projected/447cc5fa-a004-4b09-a0e0-d59b95fa9262-kube-api-access-z7fn9\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356444 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-registration-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-etc-kubernetes\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-systemd-units\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d3beb8a-488b-441f-b7d4-01ce783ad5d5-hosts-file\") pod \"node-resolver-s66k8\" (UID: \"1d3beb8a-488b-441f-b7d4-01ce783ad5d5\") " pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356557 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-cnibin\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356590 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-systemd\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c7318f-e81d-4543-9c96-d5aaca7adeff-tmp\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-var-lib-kubelet\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2edba168-5b26-42e4-a3c3-db9d380468c0-cni-binary-copy\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356708 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/447cc5fa-a004-4b09-a0e0-d59b95fa9262-ovnkube-config\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23725b74-f8de-4145-85bc-574758306a84-serviceca\") pod \"node-ca-j9sg2\" (UID: \"23725b74-f8de-4145-85bc-574758306a84\") " pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.356780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356758 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-sysctl-conf\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.357483 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-lib-modules\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.357483 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356811 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-daemon-config\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.357483 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.357483 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-var-lib-kubelet\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.357483 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7585\" (UniqueName: \"kubernetes.io/projected/c3c7318f-e81d-4543-9c96-d5aaca7adeff-kube-api-access-n7585\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.357483 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356921 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-var-lib-openvswitch\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.357483 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356947 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-cni-netd\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.357483 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-run\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.357483 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.356990 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-tuned\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.369330 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.369174 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tmx88" Jul 29 17:34:34.375576 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.375263 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tmx88" Jul 29 17:34:34.457575 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457541 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-daemon-config\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.457575 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457579 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-var-lib-kubelet\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7585\" (UniqueName: \"kubernetes.io/projected/c3c7318f-e81d-4543-9c96-d5aaca7adeff-kube-api-access-n7585\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457649 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-var-lib-openvswitch\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457671 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-cni-netd\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457691 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-run\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-tuned\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457732 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-cnibin\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-slash\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.457812 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-log-socket\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/447cc5fa-a004-4b09-a0e0-d59b95fa9262-env-overrides\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44e17049-7d2e-490f-8a4e-c45a4fb28206-iptables-alerter-script\") pod \"iptables-alerter-7c5pz\" (UID: \"44e17049-7d2e-490f-8a4e-c45a4fb28206\") " pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457897 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-run-k8s-cni-cncf-io\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457922 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-os-release\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457947 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-kubelet-config\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.457970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-system-cni-dir\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458000 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-cni-dir\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-run-systemd\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-run-ovn-kubernetes\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458078 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-cnibin\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458148 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-cni-bin\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458150 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-slash\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458188 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-log-socket\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458221 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-cni-bin\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458230 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-daemon-config\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.458282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458268 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-cni-netd\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458267 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/447cc5fa-a004-4b09-a0e0-d59b95fa9262-ovn-node-metrics-cert\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458335 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-modprobe-d\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdc5063b-6410-4dfe-86c0-a42e4e10b60d-konnectivity-ca\") pod \"konnectivity-agent-qcwb6\" (UID: \"cdc5063b-6410-4dfe-86c0-a42e4e10b60d\") " pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458382 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-kubelet-config\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-run-openvswitch\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d54bc7ed-6203-453b-81e7-8e0170ffa718-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-sysconfig\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-socket-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjrz\" (UniqueName: \"kubernetes.io/projected/b057caf9-7108-4aac-baff-254996f04872-kube-api-access-fgjrz\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458489 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-kubelet\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-run-ovn\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458523 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-etc-selinux\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458539 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e17049-7d2e-490f-8a4e-c45a4fb28206-host-slash\") pod \"iptables-alerter-7c5pz\" (UID: \"44e17049-7d2e-490f-8a4e-c45a4fb28206\") " pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.458546 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:34.459120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-var-lib-cni-bin\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdc5063b-6410-4dfe-86c0-a42e4e10b60d-agent-certs\") pod \"konnectivity-agent-qcwb6\" (UID: \"cdc5063b-6410-4dfe-86c0-a42e4e10b60d\") " pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458584 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-conf-dir\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458583 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.458610 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs podName:638db2e6-2136-4236-b37b-49b391776c7f nodeName:}" failed. No retries permitted until 2026-07-29 17:34:34.958590491 +0000 UTC m=+2.999475780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs") pod "network-metrics-daemon-2rvxq" (UID: "638db2e6-2136-4236-b37b-49b391776c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458614 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-conf-dir\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23725b74-f8de-4145-85bc-574758306a84-host\") pod \"node-ca-j9sg2\" (UID: \"23725b74-f8de-4145-85bc-574758306a84\") " pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458645 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/447cc5fa-a004-4b09-a0e0-d59b95fa9262-env-overrides\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458654 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-var-lib-kubelet\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458835 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44e17049-7d2e-490f-8a4e-c45a4fb28206-iptables-alerter-script\") pod \"iptables-alerter-7c5pz\" (UID: \"44e17049-7d2e-490f-8a4e-c45a4fb28206\") " pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458838 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23725b74-f8de-4145-85bc-574758306a84-host\") pod \"node-ca-j9sg2\" (UID: \"23725b74-f8de-4145-85bc-574758306a84\") " pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458880 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-run-k8s-cni-cncf-io\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458916 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-os-release\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458920 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-sysconfig\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458915 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-var-lib-openvswitch\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458966 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-kubelet\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458999 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-socket-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.459912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459007 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-run-ovn\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459017 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-run-systemd\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459021 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-etc-selinux\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459039 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-var-lib-cni-bin\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459078 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-run\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459120 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459125 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-modprobe-d\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459155 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-run-openvswitch\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459170 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-run-ovn-kubernetes\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459183 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d54bc7ed-6203-453b-81e7-8e0170ffa718-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.458652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d54bc7ed-6203-453b-81e7-8e0170ffa718-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459179 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459210 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-system-cni-dir\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459235 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e17049-7d2e-490f-8a4e-c45a4fb28206-host-slash\") pod \"iptables-alerter-7c5pz\" (UID: \"44e17049-7d2e-490f-8a4e-c45a4fb28206\") " pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459238 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-sys-fs\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459289 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-cni-dir\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.460674 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdnq6\" (UniqueName: \"kubernetes.io/projected/638db2e6-2136-4236-b37b-49b391776c7f-kube-api-access-tdnq6\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-var-lib-cni-multus\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459388 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rbj\" (UniqueName: \"kubernetes.io/projected/23725b74-f8de-4145-85bc-574758306a84-kube-api-access-86rbj\") pod \"node-ca-j9sg2\" (UID: \"23725b74-f8de-4145-85bc-574758306a84\") " pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459443 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-sys\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459491 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-sys\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459530 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-var-lib-cni-multus\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459583 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-sys-fs\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459660 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-host\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459692 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-socket-dir-parent\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459723 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-run-netns\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-run-multus-certs\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459795 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdc5063b-6410-4dfe-86c0-a42e4e10b60d-konnectivity-ca\") pod \"konnectivity-agent-qcwb6\" (UID: \"cdc5063b-6410-4dfe-86c0-a42e4e10b60d\") " pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-run-multus-certs\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459807 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-multus-socket-dir-parent\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459703 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d54bc7ed-6203-453b-81e7-8e0170ffa718-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459846 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-run-netns\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459859 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/447cc5fa-a004-4b09-a0e0-d59b95fa9262-ovnkube-script-lib\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459883 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-host\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.461476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.459924 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d3beb8a-488b-441f-b7d4-01ce783ad5d5-tmp-dir\") pod \"node-resolver-s66k8\" (UID: \"1d3beb8a-488b-441f-b7d4-01ce783ad5d5\") " pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460031 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88fnw\" (UniqueName: \"kubernetes.io/projected/1d3beb8a-488b-441f-b7d4-01ce783ad5d5-kube-api-access-88fnw\") pod \"node-resolver-s66k8\" (UID: \"1d3beb8a-488b-441f-b7d4-01ce783ad5d5\") " pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-dbus\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460100 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-dbus\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460122 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-kubernetes\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460141 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-os-release\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460159 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml5mh\" (UniqueName: \"kubernetes.io/projected/2edba168-5b26-42e4-a3c3-db9d380468c0-kube-api-access-ml5mh\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460180 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-etc-openvswitch\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d54bc7ed-6203-453b-81e7-8e0170ffa718-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txpc2\" (UniqueName: \"kubernetes.io/projected/d54bc7ed-6203-453b-81e7-8e0170ffa718-kube-api-access-txpc2\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-sysctl-d\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-run-netns\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-node-log\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-system-cni-dir\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-device-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460362 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d3beb8a-488b-441f-b7d4-01ce783ad5d5-tmp-dir\") pod \"node-resolver-s66k8\" (UID: \"1d3beb8a-488b-441f-b7d4-01ce783ad5d5\") " pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94q7k\" (UniqueName: \"kubernetes.io/projected/44e17049-7d2e-490f-8a4e-c45a4fb28206-kube-api-access-94q7k\") pod \"iptables-alerter-7c5pz\" (UID: \"44e17049-7d2e-490f-8a4e-c45a4fb28206\") " pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.462553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460396 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-hostroot\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7fn9\" (UniqueName: \"kubernetes.io/projected/447cc5fa-a004-4b09-a0e0-d59b95fa9262-kube-api-access-z7fn9\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460423 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/447cc5fa-a004-4b09-a0e0-d59b95fa9262-ovnkube-script-lib\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460499 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-host-run-netns\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-registration-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460558 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-sysctl-d\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460560 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-kubernetes\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460639 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-system-cni-dir\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460675 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-node-log\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.460737 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460743 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-os-release\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.460784 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret podName:9a0b10b1-1e60-438e-9ef5-cd3aff57a27b nodeName:}" failed. No retries permitted until 2026-07-29 17:34:34.960768294 +0000 UTC m=+3.001653575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret") pod "global-pull-secret-syncer-nk54l" (UID: "9a0b10b1-1e60-438e-9ef5-cd3aff57a27b") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460806 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-registration-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460817 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b057caf9-7108-4aac-baff-254996f04872-device-dir\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460845 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-hostroot\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460848 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-etc-openvswitch\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.463398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460860 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-etc-kubernetes\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460911 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-etc-kubernetes\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-systemd-units\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.460982 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d3beb8a-488b-441f-b7d4-01ce783ad5d5-hosts-file\") pod \"node-resolver-s66k8\" (UID: \"1d3beb8a-488b-441f-b7d4-01ce783ad5d5\") " pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-cnibin\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461014 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/447cc5fa-a004-4b09-a0e0-d59b95fa9262-systemd-units\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-systemd\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c7318f-e81d-4543-9c96-d5aaca7adeff-tmp\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461074 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d3beb8a-488b-441f-b7d4-01ce783ad5d5-hosts-file\") pod \"node-resolver-s66k8\" (UID: \"1d3beb8a-488b-441f-b7d4-01ce783ad5d5\") " pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-var-lib-kubelet\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461092 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d54bc7ed-6203-453b-81e7-8e0170ffa718-cnibin\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461130 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-systemd\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461141 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2edba168-5b26-42e4-a3c3-db9d380468c0-host-var-lib-kubelet\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461159 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2edba168-5b26-42e4-a3c3-db9d380468c0-cni-binary-copy\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461231 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d54bc7ed-6203-453b-81e7-8e0170ffa718-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461252 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/447cc5fa-a004-4b09-a0e0-d59b95fa9262-ovnkube-config\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461281 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23725b74-f8de-4145-85bc-574758306a84-serviceca\") pod \"node-ca-j9sg2\" (UID: \"23725b74-f8de-4145-85bc-574758306a84\") " pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-sysctl-conf\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.464115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-lib-modules\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.464945 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461464 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-lib-modules\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.464945 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461565 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-sysctl-conf\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.464945 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461722 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2edba168-5b26-42e4-a3c3-db9d380468c0-cni-binary-copy\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.464945 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461769 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/447cc5fa-a004-4b09-a0e0-d59b95fa9262-ovnkube-config\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.464945 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.461779 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23725b74-f8de-4145-85bc-574758306a84-serviceca\") pod \"node-ca-j9sg2\" (UID: \"23725b74-f8de-4145-85bc-574758306a84\") " pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.464945 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.463410 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/447cc5fa-a004-4b09-a0e0-d59b95fa9262-ovn-node-metrics-cert\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.464945 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.463524 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdc5063b-6410-4dfe-86c0-a42e4e10b60d-agent-certs\") pod \"konnectivity-agent-qcwb6\" (UID: \"cdc5063b-6410-4dfe-86c0-a42e4e10b60d\") " pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:34:34.464945 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.463673 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3c7318f-e81d-4543-9c96-d5aaca7adeff-etc-tuned\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.464945 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.463841 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c7318f-e81d-4543-9c96-d5aaca7adeff-tmp\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.467412 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.467036 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:34.467412 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.467064 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:34.467412 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.467077 2560 projected.go:196] Error preparing data for projected volume kube-api-access-w7tkh for pod openshift-network-diagnostics/network-check-target-hxnr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:34.467412 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.467143 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh podName:9f1bbcc4-7f4e-43b1-b81a-515e94ec2543 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:34.967125306 +0000 UTC m=+3.008010619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w7tkh" (UniqueName: "kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh") pod "network-check-target-hxnr6" (UID: "9f1bbcc4-7f4e-43b1-b81a-515e94ec2543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:34.468209 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.468185 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7585\" (UniqueName: \"kubernetes.io/projected/c3c7318f-e81d-4543-9c96-d5aaca7adeff-kube-api-access-n7585\") pod \"tuned-lg2jd\" (UID: \"c3c7318f-e81d-4543-9c96-d5aaca7adeff\") " pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.477195 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.474399 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml5mh\" (UniqueName: \"kubernetes.io/projected/2edba168-5b26-42e4-a3c3-db9d380468c0-kube-api-access-ml5mh\") pod \"multus-bstl2\" (UID: \"2edba168-5b26-42e4-a3c3-db9d380468c0\") " pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.477195 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.474733 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rbj\" (UniqueName: \"kubernetes.io/projected/23725b74-f8de-4145-85bc-574758306a84-kube-api-access-86rbj\") pod \"node-ca-j9sg2\" (UID: \"23725b74-f8de-4145-85bc-574758306a84\") " pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.477195 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.474780 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94q7k\" (UniqueName: \"kubernetes.io/projected/44e17049-7d2e-490f-8a4e-c45a4fb28206-kube-api-access-94q7k\") pod \"iptables-alerter-7c5pz\" (UID: \"44e17049-7d2e-490f-8a4e-c45a4fb28206\") " pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.477195 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.474869 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgjrz\" (UniqueName: \"kubernetes.io/projected/b057caf9-7108-4aac-baff-254996f04872-kube-api-access-fgjrz\") pod \"aws-ebs-csi-driver-node-fbgk2\" (UID: \"b057caf9-7108-4aac-baff-254996f04872\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.477195 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.475203 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88fnw\" (UniqueName: \"kubernetes.io/projected/1d3beb8a-488b-441f-b7d4-01ce783ad5d5-kube-api-access-88fnw\") pod \"node-resolver-s66k8\" (UID: \"1d3beb8a-488b-441f-b7d4-01ce783ad5d5\") " pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.477195 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.475261 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7fn9\" (UniqueName: \"kubernetes.io/projected/447cc5fa-a004-4b09-a0e0-d59b95fa9262-kube-api-access-z7fn9\") pod \"ovnkube-node-l5jjx\" (UID: \"447cc5fa-a004-4b09-a0e0-d59b95fa9262\") " pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.477660 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.477634 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txpc2\" (UniqueName: \"kubernetes.io/projected/d54bc7ed-6203-453b-81e7-8e0170ffa718-kube-api-access-txpc2\") pod \"multus-additional-cni-plugins-8dxl6\" (UID: \"d54bc7ed-6203-453b-81e7-8e0170ffa718\") " pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.477792 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.477763 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdnq6\" (UniqueName: \"kubernetes.io/projected/638db2e6-2136-4236-b37b-49b391776c7f-kube-api-access-tdnq6\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:34.643765 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.643670 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bstl2" Jul 29 17:34:34.655883 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.655847 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:34:34.666144 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.665929 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s66k8" Jul 29 17:34:34.671670 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.671644 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" Jul 29 17:34:34.678243 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.678216 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j9sg2" Jul 29 17:34:34.686925 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.686897 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" Jul 29 17:34:34.695590 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.695557 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:34:34.701268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.701243 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" Jul 29 17:34:34.710097 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.710073 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7c5pz" Jul 29 17:34:34.798503 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.798467 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 17:34:34.965454 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.965367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:34.965454 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:34.965416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:34.965669 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.965531 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:34.965669 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.965610 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret podName:9a0b10b1-1e60-438e-9ef5-cd3aff57a27b nodeName:}" failed. No retries permitted until 2026-07-29 17:34:35.965590424 +0000 UTC m=+4.006475721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret") pod "global-pull-secret-syncer-nk54l" (UID: "9a0b10b1-1e60-438e-9ef5-cd3aff57a27b") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:34.965669 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.965533 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:34.965816 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:34.965705 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs podName:638db2e6-2136-4236-b37b-49b391776c7f nodeName:}" failed. No retries permitted until 2026-07-29 17:34:35.965685559 +0000 UTC m=+4.006570847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs") pod "network-metrics-daemon-2rvxq" (UID: "638db2e6-2136-4236-b37b-49b391776c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:35.066439 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.066399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:35.066599 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:35.066570 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:35.066599 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:35.066596 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:35.066679 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:35.066606 2560 projected.go:196] Error preparing data for projected volume kube-api-access-w7tkh for pod openshift-network-diagnostics/network-check-target-hxnr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:35.066679 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:35.066661 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh podName:9f1bbcc4-7f4e-43b1-b81a-515e94ec2543 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:36.066646818 +0000 UTC m=+4.107532118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7tkh" (UniqueName: "kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh") pod "network-check-target-hxnr6" (UID: "9f1bbcc4-7f4e-43b1-b81a-515e94ec2543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:35.350947 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:35.350914 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2edba168_5b26_42e4_a3c3_db9d380468c0.slice/crio-1b6a9f30397e2de2922f4ed8e1c400c144717ea33041524ea3a730bde9c7e577 WatchSource:0}: Error finding container 1b6a9f30397e2de2922f4ed8e1c400c144717ea33041524ea3a730bde9c7e577: Status 404 returned error can't find the container with id 1b6a9f30397e2de2922f4ed8e1c400c144717ea33041524ea3a730bde9c7e577 Jul 29 17:34:35.352692 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:35.352658 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c7318f_e81d_4543_9c96_d5aaca7adeff.slice/crio-2f50e2b64056d80d3434b14defc580fbd22a3e6dcf27f2187d00749bdb8a379e WatchSource:0}: Error finding container 2f50e2b64056d80d3434b14defc580fbd22a3e6dcf27f2187d00749bdb8a379e: Status 404 returned error can't find the container with id 2f50e2b64056d80d3434b14defc580fbd22a3e6dcf27f2187d00749bdb8a379e Jul 29 17:34:35.354600 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:35.354580 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb057caf9_7108_4aac_baff_254996f04872.slice/crio-afddcffe458b7b83ec4f0e738adbed66a6b6d328a87c7054fc9207f9094e1c45 WatchSource:0}: Error finding container afddcffe458b7b83ec4f0e738adbed66a6b6d328a87c7054fc9207f9094e1c45: Status 404 returned error can't find the container with id afddcffe458b7b83ec4f0e738adbed66a6b6d328a87c7054fc9207f9094e1c45 Jul 29 17:34:35.361091 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:35.361058 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447cc5fa_a004_4b09_a0e0_d59b95fa9262.slice/crio-0929f5fcc43d38e4cb023c485db9a17e5afc01e1c5f1b41f45aa0ded46cc04ab WatchSource:0}: Error finding container 0929f5fcc43d38e4cb023c485db9a17e5afc01e1c5f1b41f45aa0ded46cc04ab: Status 404 returned error can't find the container with id 0929f5fcc43d38e4cb023c485db9a17e5afc01e1c5f1b41f45aa0ded46cc04ab Jul 29 17:34:35.361424 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:35.361388 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54bc7ed_6203_453b_81e7_8e0170ffa718.slice/crio-56c3678073e9376edd8c5bcea9ba90baf11db9ac89cfde49b50e7a0b6979a469 WatchSource:0}: Error finding container 56c3678073e9376edd8c5bcea9ba90baf11db9ac89cfde49b50e7a0b6979a469: Status 404 returned error can't find the container with id 56c3678073e9376edd8c5bcea9ba90baf11db9ac89cfde49b50e7a0b6979a469 Jul 29 17:34:35.362487 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:35.362388 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3beb8a_488b_441f_b7d4_01ce783ad5d5.slice/crio-d3755a77799810415d131ca1c13c2305a9cdc89098e6d87cefef0df7e4b00f2d WatchSource:0}: Error finding container d3755a77799810415d131ca1c13c2305a9cdc89098e6d87cefef0df7e4b00f2d: Status 404 returned error can't find the container with id d3755a77799810415d131ca1c13c2305a9cdc89098e6d87cefef0df7e4b00f2d Jul 29 17:34:35.363990 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:35.363967 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e17049_7d2e_490f_8a4e_c45a4fb28206.slice/crio-98fe7ae642d0f181afb3d2b46851633bc477089c5063587b303faff5054df115 WatchSource:0}: Error finding container 98fe7ae642d0f181afb3d2b46851633bc477089c5063587b303faff5054df115: Status 404 returned error can't find the container with id 98fe7ae642d0f181afb3d2b46851633bc477089c5063587b303faff5054df115 Jul 29 17:34:35.366126 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:35.366103 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc5063b_6410_4dfe_86c0_a42e4e10b60d.slice/crio-67c63c3fba63e1583803167372583109a61338d6e017fd4d1c3c7fe83560d676 WatchSource:0}: Error finding container 67c63c3fba63e1583803167372583109a61338d6e017fd4d1c3c7fe83560d676: Status 404 returned error can't find the container with id 67c63c3fba63e1583803167372583109a61338d6e017fd4d1c3c7fe83560d676 Jul 29 17:34:35.368358 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:34:35.368236 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23725b74_f8de_4145_85bc_574758306a84.slice/crio-cf7889cb7ad472bf682de52d50b06c89e9c26d3fead2d48ad3aff352ccf46f5c WatchSource:0}: Error finding container cf7889cb7ad472bf682de52d50b06c89e9c26d3fead2d48ad3aff352ccf46f5c: Status 404 returned error can't find the container with id cf7889cb7ad472bf682de52d50b06c89e9c26d3fead2d48ad3aff352ccf46f5c Jul 29 17:34:35.379390 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.379340 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:29:34 +0000 UTC" deadline="2028-01-24 16:44:05.929923262 +0000 UTC" Jul 29 17:34:35.379537 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.379379 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13055h9m30.550548207s" Jul 29 17:34:35.484785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.484605 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:35.484928 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:35.484891 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:35.496135 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.496104 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal" event={"ID":"32ce9ec9d7e6ed8fb9a0a2b24a14d2ec","Type":"ContainerStarted","Data":"c4c1182dae334c687e62cce0469cd59244031504772f0ddc0707e6cbc20bdb77"} Jul 29 17:34:35.498126 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.498099 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j9sg2" event={"ID":"23725b74-f8de-4145-85bc-574758306a84","Type":"ContainerStarted","Data":"cf7889cb7ad472bf682de52d50b06c89e9c26d3fead2d48ad3aff352ccf46f5c"} Jul 29 17:34:35.499097 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.499073 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s66k8" event={"ID":"1d3beb8a-488b-441f-b7d4-01ce783ad5d5","Type":"ContainerStarted","Data":"d3755a77799810415d131ca1c13c2305a9cdc89098e6d87cefef0df7e4b00f2d"} Jul 29 17:34:35.500908 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.500884 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qcwb6" event={"ID":"cdc5063b-6410-4dfe-86c0-a42e4e10b60d","Type":"ContainerStarted","Data":"67c63c3fba63e1583803167372583109a61338d6e017fd4d1c3c7fe83560d676"} Jul 29 17:34:35.502801 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.502775 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" event={"ID":"b057caf9-7108-4aac-baff-254996f04872","Type":"ContainerStarted","Data":"afddcffe458b7b83ec4f0e738adbed66a6b6d328a87c7054fc9207f9094e1c45"} Jul 29 17:34:35.503875 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.503855 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" event={"ID":"c3c7318f-e81d-4543-9c96-d5aaca7adeff","Type":"ContainerStarted","Data":"2f50e2b64056d80d3434b14defc580fbd22a3e6dcf27f2187d00749bdb8a379e"} Jul 29 17:34:35.505094 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.505073 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7c5pz" event={"ID":"44e17049-7d2e-490f-8a4e-c45a4fb28206","Type":"ContainerStarted","Data":"98fe7ae642d0f181afb3d2b46851633bc477089c5063587b303faff5054df115"} Jul 29 17:34:35.506814 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.506797 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" event={"ID":"d54bc7ed-6203-453b-81e7-8e0170ffa718","Type":"ContainerStarted","Data":"56c3678073e9376edd8c5bcea9ba90baf11db9ac89cfde49b50e7a0b6979a469"} Jul 29 17:34:35.507901 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.507862 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" event={"ID":"447cc5fa-a004-4b09-a0e0-d59b95fa9262","Type":"ContainerStarted","Data":"0929f5fcc43d38e4cb023c485db9a17e5afc01e1c5f1b41f45aa0ded46cc04ab"} Jul 29 17:34:35.508937 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.508911 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bstl2" event={"ID":"2edba168-5b26-42e4-a3c3-db9d380468c0","Type":"ContainerStarted","Data":"1b6a9f30397e2de2922f4ed8e1c400c144717ea33041524ea3a730bde9c7e577"} Jul 29 17:34:35.513397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.513271 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-94.ec2.internal" podStartSLOduration=2.513252461 podStartE2EDuration="2.513252461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:35.512233206 +0000 UTC m=+3.553118527" watchObservedRunningTime="2026-07-29 17:34:35.513252461 +0000 UTC m=+3.554137752" Jul 29 17:34:35.972785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.972745 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:35.972785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:35.972789 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:35.973018 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:35.972890 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:35.973018 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:35.972953 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs podName:638db2e6-2136-4236-b37b-49b391776c7f nodeName:}" failed. No retries permitted until 2026-07-29 17:34:37.972939041 +0000 UTC m=+6.013824322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs") pod "network-metrics-daemon-2rvxq" (UID: "638db2e6-2136-4236-b37b-49b391776c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:35.973244 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:35.973226 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:35.973330 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:35.973264 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret podName:9a0b10b1-1e60-438e-9ef5-cd3aff57a27b nodeName:}" failed. No retries permitted until 2026-07-29 17:34:37.97325509 +0000 UTC m=+6.014140370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret") pod "global-pull-secret-syncer-nk54l" (UID: "9a0b10b1-1e60-438e-9ef5-cd3aff57a27b") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:36.073135 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:36.073073 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:36.073331 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:36.073297 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:36.073449 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:36.073341 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:36.073449 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:36.073353 2560 projected.go:196] Error preparing data for projected volume kube-api-access-w7tkh for pod openshift-network-diagnostics/network-check-target-hxnr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:36.073449 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:36.073415 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh podName:9f1bbcc4-7f4e-43b1-b81a-515e94ec2543 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:38.073394587 +0000 UTC m=+6.114279871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7tkh" (UniqueName: "kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh") pod "network-check-target-hxnr6" (UID: "9f1bbcc4-7f4e-43b1-b81a-515e94ec2543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:36.379633 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:36.379562 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:29:34 +0000 UTC" deadline="2028-01-12 22:21:08.701461979 +0000 UTC" Jul 29 17:34:36.379633 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:36.379622 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12772h46m32.321843105s" Jul 29 17:34:36.487402 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:36.486036 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:36.487402 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:36.486185 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:36.487402 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:36.487211 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:36.487402 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:36.487349 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:36.525268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:36.523915 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d3f6cec1d9e701948f13a49a64d6383" containerID="4e3adca55f8ab02d24fca91667b8f59d7b17b11a1b49d935cae1a8ef3379e6c6" exitCode=0 Jul 29 17:34:36.525268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:36.525028 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" event={"ID":"9d3f6cec1d9e701948f13a49a64d6383","Type":"ContainerDied","Data":"4e3adca55f8ab02d24fca91667b8f59d7b17b11a1b49d935cae1a8ef3379e6c6"} Jul 29 17:34:37.484829 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:37.484299 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:37.484829 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:37.484470 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:37.537233 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:37.537192 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" event={"ID":"9d3f6cec1d9e701948f13a49a64d6383","Type":"ContainerStarted","Data":"61f13a81b69fbb86f522c6f3b146a8e9af5f8235323a0ce8d743bf908508db5a"} Jul 29 17:34:37.988573 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:37.988480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:37.988573 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:37.988578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:37.988839 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:37.988710 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:37.988839 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:37.988773 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret podName:9a0b10b1-1e60-438e-9ef5-cd3aff57a27b nodeName:}" failed. No retries permitted until 2026-07-29 17:34:41.988754861 +0000 UTC m=+10.029640133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret") pod "global-pull-secret-syncer-nk54l" (UID: "9a0b10b1-1e60-438e-9ef5-cd3aff57a27b") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:37.989177 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:37.989159 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:37.989249 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:37.989211 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs podName:638db2e6-2136-4236-b37b-49b391776c7f nodeName:}" failed. No retries permitted until 2026-07-29 17:34:41.989197044 +0000 UTC m=+10.030082316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs") pod "network-metrics-daemon-2rvxq" (UID: "638db2e6-2136-4236-b37b-49b391776c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:38.091261 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:38.090666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:38.091261 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:38.090822 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:38.091261 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:38.090841 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:38.091261 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:38.090853 2560 projected.go:196] Error preparing data for projected volume kube-api-access-w7tkh for pod openshift-network-diagnostics/network-check-target-hxnr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:38.091261 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:38.090911 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh podName:9f1bbcc4-7f4e-43b1-b81a-515e94ec2543 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:42.090893776 +0000 UTC m=+10.131779046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7tkh" (UniqueName: "kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh") pod "network-check-target-hxnr6" (UID: "9f1bbcc4-7f4e-43b1-b81a-515e94ec2543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:38.484475 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:38.484413 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:38.484647 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:38.484546 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:38.484915 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:38.484892 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:38.485285 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:38.484997 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:39.484687 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:39.484156 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:39.484687 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:39.484300 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:40.484492 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:40.484462 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:40.484941 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:40.484569 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:40.485071 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:40.485054 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:40.485152 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:40.485134 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:41.484210 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:41.484132 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:41.484371 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:41.484285 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:42.025334 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:42.025279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:42.025799 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:42.025360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:42.025799 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.025460 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:42.025799 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.025458 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:42.025799 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.025531 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs podName:638db2e6-2136-4236-b37b-49b391776c7f nodeName:}" failed. No retries permitted until 2026-07-29 17:34:50.025514401 +0000 UTC m=+18.066399670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs") pod "network-metrics-daemon-2rvxq" (UID: "638db2e6-2136-4236-b37b-49b391776c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:42.025799 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.025545 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret podName:9a0b10b1-1e60-438e-9ef5-cd3aff57a27b nodeName:}" failed. No retries permitted until 2026-07-29 17:34:50.02553933 +0000 UTC m=+18.066424598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret") pod "global-pull-secret-syncer-nk54l" (UID: "9a0b10b1-1e60-438e-9ef5-cd3aff57a27b") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:42.126728 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:42.126684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:42.126917 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.126872 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:42.126917 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.126898 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:42.126917 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.126912 2560 projected.go:196] Error preparing data for projected volume kube-api-access-w7tkh for pod openshift-network-diagnostics/network-check-target-hxnr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:42.127048 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.126979 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh podName:9f1bbcc4-7f4e-43b1-b81a-515e94ec2543 nodeName:}" failed. No retries permitted until 2026-07-29 17:34:50.126958662 +0000 UTC m=+18.167843940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7tkh" (UniqueName: "kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh") pod "network-check-target-hxnr6" (UID: "9f1bbcc4-7f4e-43b1-b81a-515e94ec2543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:42.485864 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:42.485774 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:42.486015 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.485882 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:42.486015 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:42.485900 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:42.486142 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:42.486117 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:43.484562 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:43.484529 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:43.484964 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:43.484675 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:44.484445 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:44.484414 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:44.484618 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:44.484414 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:44.484618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:44.484554 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:44.484618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:44.484602 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:45.484218 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:45.484181 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:45.484431 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:45.484346 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:46.484512 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:46.484467 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:46.484927 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:46.484467 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:46.484927 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:46.484610 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:46.484927 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:46.484679 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:47.484356 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:47.484299 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:47.484527 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:47.484457 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:48.484075 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:48.484041 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:48.484578 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:48.484041 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:48.484578 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:48.484169 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:48.484578 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:48.484218 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:49.484110 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:49.484073 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:49.484636 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:49.484201 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:50.087238 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:50.087199 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:50.087454 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:50.087254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:50.087454 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.087389 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:50.087454 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.087388 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:50.087454 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.087448 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs podName:638db2e6-2136-4236-b37b-49b391776c7f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:06.087432707 +0000 UTC m=+34.128317989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs") pod "network-metrics-daemon-2rvxq" (UID: "638db2e6-2136-4236-b37b-49b391776c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:34:50.087655 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.087462 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret podName:9a0b10b1-1e60-438e-9ef5-cd3aff57a27b nodeName:}" failed. No retries permitted until 2026-07-29 17:35:06.08745656 +0000 UTC m=+34.128341827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret") pod "global-pull-secret-syncer-nk54l" (UID: "9a0b10b1-1e60-438e-9ef5-cd3aff57a27b") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:34:50.188642 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:50.188599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:50.188838 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.188794 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:34:50.188838 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.188819 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:34:50.188838 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.188831 2560 projected.go:196] Error preparing data for projected volume kube-api-access-w7tkh for pod openshift-network-diagnostics/network-check-target-hxnr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:50.188992 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.188893 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh podName:9f1bbcc4-7f4e-43b1-b81a-515e94ec2543 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:06.188872348 +0000 UTC m=+34.229757617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7tkh" (UniqueName: "kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh") pod "network-check-target-hxnr6" (UID: "9f1bbcc4-7f4e-43b1-b81a-515e94ec2543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:34:50.484839 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:50.484741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:50.484839 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:50.484741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:50.485258 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.484865 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:50.485258 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:50.484945 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:51.484539 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:51.484501 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:51.484724 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:51.484637 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:52.484935 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:52.484889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:52.485454 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:52.485004 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:52.485454 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:52.485066 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:52.485454 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:52.485198 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:53.484105 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:53.484062 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:53.484284 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:53.484199 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:54.491944 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:54.486883 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:54.491944 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:54.487008 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:54.491944 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:54.488119 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:54.491944 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:54.488233 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:54.586901 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:54.586858 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" event={"ID":"c3c7318f-e81d-4543-9c96-d5aaca7adeff","Type":"ContainerStarted","Data":"a321a03c5029000cdb29b572d2d8091e50c3c05a2da5db2f4b32e54be28f0c00"} Jul 29 17:34:54.611246 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:54.608657 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-94.ec2.internal" podStartSLOduration=21.608621051 podStartE2EDuration="21.608621051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:37.553592844 +0000 UTC m=+5.594478134" watchObservedRunningTime="2026-07-29 17:34:54.608621051 +0000 UTC m=+22.649506342" Jul 29 17:34:54.611246 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:54.609731 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lg2jd" podStartSLOduration=3.519716374 podStartE2EDuration="22.609713631s" totalImagesPullingTime="19.089997257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:54.608466219 +0000 UTC m=+22.649351500" watchObservedRunningTime="2026-07-29 17:34:54.609713631 +0000 UTC m=+22.650598923" Jul 29 17:34:55.484855 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.484520 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:55.484989 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:55.484891 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:55.590599 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.590564 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j9sg2" event={"ID":"23725b74-f8de-4145-85bc-574758306a84","Type":"ContainerStarted","Data":"60095863e285b771ee491fa27bbd73eb9297aa0cfcf822ee18dd03279a986965"} Jul 29 17:34:55.591957 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.591930 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s66k8" event={"ID":"1d3beb8a-488b-441f-b7d4-01ce783ad5d5","Type":"ContainerStarted","Data":"26ad3dc2fbc834068e4fc36598c30b0f30d9b03472469665bbb25429e818bb74"} Jul 29 17:34:55.593397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.593356 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qcwb6" event={"ID":"cdc5063b-6410-4dfe-86c0-a42e4e10b60d","Type":"ContainerStarted","Data":"9a737b9a8da8eacd05c4bbf1666ce6dba3424298adb7c98657bc56f362d12c32"} Jul 29 17:34:55.594796 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.594770 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" event={"ID":"b057caf9-7108-4aac-baff-254996f04872","Type":"ContainerStarted","Data":"95777989dfc4e521c10b3ec336f06eba3adef12cf55f5e2099348bb583c2d4d1"} Jul 29 17:34:55.596183 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.596161 2560 generic.go:356] "Generic (PLEG): container finished" podID="d54bc7ed-6203-453b-81e7-8e0170ffa718" containerID="06c9f56cb6dce4884b4083267dfac8d71fb4a70ad87cc9b15bf60aec28d2b584" exitCode=0 Jul 29 17:34:55.596266 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.596241 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" event={"ID":"d54bc7ed-6203-453b-81e7-8e0170ffa718","Type":"ContainerDied","Data":"06c9f56cb6dce4884b4083267dfac8d71fb4a70ad87cc9b15bf60aec28d2b584"} Jul 29 17:34:55.599349 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.599330 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" event={"ID":"447cc5fa-a004-4b09-a0e0-d59b95fa9262","Type":"ContainerStarted","Data":"31c3ec4728ba4a472e52876093d5698c0d4b17cd515ead4e971b7432c700d217"} Jul 29 17:34:55.599446 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.599395 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" event={"ID":"447cc5fa-a004-4b09-a0e0-d59b95fa9262","Type":"ContainerStarted","Data":"b29b47ac5637ad0b0e817204c4582d7466be6fd931dd4e6c2e16ccdebc48e1b5"} Jul 29 17:34:55.599446 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.599436 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" event={"ID":"447cc5fa-a004-4b09-a0e0-d59b95fa9262","Type":"ContainerStarted","Data":"21beb7acb20f4b493e98078767772ac280bc5ce838e472d1504c415a67889be0"} Jul 29 17:34:55.599527 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.599473 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" event={"ID":"447cc5fa-a004-4b09-a0e0-d59b95fa9262","Type":"ContainerStarted","Data":"d51c49cd739ed09e7f66bde0502c015a6024f8c27809b7ff9e481de5dafd3694"} Jul 29 17:34:55.599527 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.599503 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" event={"ID":"447cc5fa-a004-4b09-a0e0-d59b95fa9262","Type":"ContainerStarted","Data":"334dc72cc511718f653bc36b99b60720be086e6c490dce36e79d8dbd0e17ba03"} Jul 29 17:34:55.599611 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.599543 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" event={"ID":"447cc5fa-a004-4b09-a0e0-d59b95fa9262","Type":"ContainerStarted","Data":"8dd69d66f316edf8a22cf135cad0e28feb3feb8fb4608a8815db76cb2a8efc50"} Jul 29 17:34:55.600602 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.600574 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bstl2" event={"ID":"2edba168-5b26-42e4-a3c3-db9d380468c0","Type":"ContainerStarted","Data":"edb28569356888b1c8b71c322d0fcf70a8ee831304518135761763955c8ccb9e"} Jul 29 17:34:55.605540 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.605503 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j9sg2" podStartSLOduration=4.5345709339999996 podStartE2EDuration="23.605490356s" totalImagesPullingTime="19.070919422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:55.605414308 +0000 UTC m=+23.646299597" watchObservedRunningTime="2026-07-29 17:34:55.605490356 +0000 UTC m=+23.646375646" Jul 29 17:34:55.622543 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.622503 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bstl2" podStartSLOduration=4.477780196 podStartE2EDuration="23.622488921s" totalImagesPullingTime="19.144708725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:55.621962386 +0000 UTC m=+23.662847688" watchObservedRunningTime="2026-07-29 17:34:55.622488921 +0000 UTC m=+23.663374209" Jul 29 17:34:55.657454 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.657407 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qcwb6" podStartSLOduration=4.58672432 podStartE2EDuration="23.657391103s" totalImagesPullingTime="19.070666783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:55.656854951 +0000 UTC m=+23.697740241" watchObservedRunningTime="2026-07-29 17:34:55.657391103 +0000 UTC m=+23.698276394" Jul 29 17:34:55.676501 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.676441 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s66k8" podStartSLOduration=4.595365528 podStartE2EDuration="23.676420429s" totalImagesPullingTime="19.081054901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:55.676286439 +0000 UTC m=+23.717171729" watchObservedRunningTime="2026-07-29 17:34:55.676420429 +0000 UTC m=+23.717305706" Jul 29 17:34:55.921397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:55.921370 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 17:34:56.417851 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:56.417727 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T17:34:55.921390983Z","UUID":"d1291763-9c81-45aa-a0e1-a227a0323f75","Handler":null,"Name":"","Endpoint":""} Jul 29 17:34:56.419837 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:56.419800 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 17:34:56.419999 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:56.419847 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 17:34:56.484035 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:56.484002 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:56.484216 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:56.484002 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:56.484216 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:56.484119 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:56.484354 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:56.484227 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:56.606276 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:56.606240 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" event={"ID":"b057caf9-7108-4aac-baff-254996f04872","Type":"ContainerStarted","Data":"1d71a2166242e8209fbcb8802046959ba5e03cb470743012ea5c0befc5df6714"} Jul 29 17:34:56.608383 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:56.608297 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7c5pz" event={"ID":"44e17049-7d2e-490f-8a4e-c45a4fb28206","Type":"ContainerStarted","Data":"f886696252f808656afd172418df74fceb6674e86def2b60aba7a162f7e09739"} Jul 29 17:34:56.624577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:56.624518 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7c5pz" podStartSLOduration=5.539772067 podStartE2EDuration="24.624448106s" totalImagesPullingTime="19.084676039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:56.623127017 +0000 UTC m=+24.664012310" watchObservedRunningTime="2026-07-29 17:34:56.624448106 +0000 UTC m=+24.665333389" Jul 29 17:34:57.484731 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:57.484698 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:57.484896 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:57.484834 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:34:57.613670 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:57.613627 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" event={"ID":"b057caf9-7108-4aac-baff-254996f04872","Type":"ContainerStarted","Data":"cb461a7445eee5b50f99bfd9600585f1c9674829f3fcfe106270f685e832d2e1"} Jul 29 17:34:57.617671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:57.617538 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" event={"ID":"447cc5fa-a004-4b09-a0e0-d59b95fa9262","Type":"ContainerStarted","Data":"446172b23158650f11c93288731f439c6b22b663c432613e03eea97df71b1018"} Jul 29 17:34:57.631231 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:57.631179 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbgk2" podStartSLOduration=4.229825509 podStartE2EDuration="25.631157569s" totalImagesPullingTime="21.40133206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:34:57.630930807 +0000 UTC m=+25.671816097" watchObservedRunningTime="2026-07-29 17:34:57.631157569 +0000 UTC m=+25.672042859" Jul 29 17:34:58.484299 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:58.484263 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:34:58.484488 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:58.484413 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:34:58.484752 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:58.484264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:34:58.484847 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:58.484824 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:34:59.484734 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:34:59.484701 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:34:59.485130 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:34:59.484831 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:35:00.268226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.268039 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:35:00.268610 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.268590 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:35:00.484547 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.484463 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:00.484547 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.484510 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:35:00.484739 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:00.484648 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:35:00.484739 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:00.484706 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:35:00.625368 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.625332 2560 generic.go:356] "Generic (PLEG): container finished" podID="d54bc7ed-6203-453b-81e7-8e0170ffa718" containerID="7010332c6b5bdad35c92c8d20d43742c789c1dae82331e4472c022f20a6e338b" exitCode=0 Jul 29 17:35:00.625564 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.625401 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" event={"ID":"d54bc7ed-6203-453b-81e7-8e0170ffa718","Type":"ContainerDied","Data":"7010332c6b5bdad35c92c8d20d43742c789c1dae82331e4472c022f20a6e338b"} Jul 29 17:35:00.629462 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.629437 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" event={"ID":"447cc5fa-a004-4b09-a0e0-d59b95fa9262","Type":"ContainerStarted","Data":"1975f84a2af262d58964a593f06d349006869f584ed150cb60bcd9def2bf9fd6"} Jul 29 17:35:00.629963 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.629696 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:35:00.629963 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.629785 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:35:00.629963 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.629865 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:35:00.629963 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.629915 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:35:00.630260 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.630241 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qcwb6" Jul 29 17:35:00.649328 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.649286 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:35:00.650159 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.650139 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:35:00.686056 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:00.685998 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" podStartSLOduration=9.545581159 podStartE2EDuration="28.685981129s" totalImagesPullingTime="19.14039997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:00.685467424 +0000 UTC m=+28.726352729" watchObservedRunningTime="2026-07-29 17:35:00.685981129 +0000 UTC m=+28.726866418" Jul 29 17:35:01.484046 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:01.483982 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:35:01.484431 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:01.484104 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:35:02.034242 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:02.034050 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2rvxq"] Jul 29 17:35:02.034682 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:02.034359 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:35:02.034682 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:02.034470 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:35:02.037779 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:02.037747 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxnr6"] Jul 29 17:35:02.038010 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:02.037889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:02.038010 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:02.037982 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:35:02.038570 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:02.038546 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nk54l"] Jul 29 17:35:02.038681 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:02.038647 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:35:02.038760 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:02.038739 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:35:02.636426 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:02.636388 2560 generic.go:356] "Generic (PLEG): container finished" podID="d54bc7ed-6203-453b-81e7-8e0170ffa718" containerID="5338d1e374a9d70294d89acb16e324b5e10e605180140f7930d2ee58bb208ece" exitCode=0 Jul 29 17:35:02.636612 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:02.636483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" event={"ID":"d54bc7ed-6203-453b-81e7-8e0170ffa718","Type":"ContainerDied","Data":"5338d1e374a9d70294d89acb16e324b5e10e605180140f7930d2ee58bb208ece"} Jul 29 17:35:03.484739 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:03.484706 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:35:03.484739 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:03.484741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:35:03.485146 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:03.484812 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:35:03.485146 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:03.484710 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:03.485146 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:03.484912 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:35:03.485146 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:03.484992 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:35:04.643842 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:04.643804 2560 generic.go:356] "Generic (PLEG): container finished" podID="d54bc7ed-6203-453b-81e7-8e0170ffa718" containerID="cb75b31852b8035a6e772e52f6eaece392df73792523a8287c0b4fab605c2227" exitCode=0 Jul 29 17:35:04.643842 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:04.643839 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" event={"ID":"d54bc7ed-6203-453b-81e7-8e0170ffa718","Type":"ContainerDied","Data":"cb75b31852b8035a6e772e52f6eaece392df73792523a8287c0b4fab605c2227"} Jul 29 17:35:05.484087 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:05.484050 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:35:05.484275 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:05.484053 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:35:05.484275 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:05.484189 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rvxq" podUID="638db2e6-2136-4236-b37b-49b391776c7f" Jul 29 17:35:05.484275 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:05.484263 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nk54l" podUID="9a0b10b1-1e60-438e-9ef5-cd3aff57a27b" Jul 29 17:35:05.484420 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:05.484051 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:05.484420 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:05.484371 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxnr6" podUID="9f1bbcc4-7f4e-43b1-b81a-515e94ec2543" Jul 29 17:35:06.109513 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:06.109420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:35:06.109513 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:06.109481 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:35:06.110016 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:06.109597 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:06.110016 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:06.109617 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:06.110016 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:06.109686 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret podName:9a0b10b1-1e60-438e-9ef5-cd3aff57a27b nodeName:}" failed. No retries permitted until 2026-07-29 17:35:38.109664055 +0000 UTC m=+66.150549335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret") pod "global-pull-secret-syncer-nk54l" (UID: "9a0b10b1-1e60-438e-9ef5-cd3aff57a27b") : object "kube-system"/"original-pull-secret" not registered Jul 29 17:35:06.110016 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:06.109707 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs podName:638db2e6-2136-4236-b37b-49b391776c7f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:38.109697552 +0000 UTC m=+66.150582836 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs") pod "network-metrics-daemon-2rvxq" (UID: "638db2e6-2136-4236-b37b-49b391776c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 17:35:06.210435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:06.210385 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:06.210630 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:06.210555 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 17:35:06.210630 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:06.210579 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 17:35:06.210630 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:06.210593 2560 projected.go:196] Error preparing data for projected volume kube-api-access-w7tkh for pod openshift-network-diagnostics/network-check-target-hxnr6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:06.210785 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:06.210651 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh podName:9f1bbcc4-7f4e-43b1-b81a-515e94ec2543 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:38.210633934 +0000 UTC m=+66.251519216 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7tkh" (UniqueName: "kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh") pod "network-check-target-hxnr6" (UID: "9f1bbcc4-7f4e-43b1-b81a-515e94ec2543") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 17:35:07.261963 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.261742 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-94.ec2.internal" event="NodeReady" Jul 29 17:35:07.262401 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.262092 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 17:35:07.303103 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.303058 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69c4dc875c-gkbrj"] Jul 29 17:35:07.305831 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.305790 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.308640 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.308038 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx"] Jul 29 17:35:07.308640 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.308441 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 17:35:07.309543 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.309351 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 17:35:07.310224 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.310057 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76556c6d69-rs85g"] Jul 29 17:35:07.310819 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.310770 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:07.311683 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.311653 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8"] Jul 29 17:35:07.311864 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.311842 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.313289 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.313261 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgjgr\"" Jul 29 17:35:07.313494 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.313471 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 17:35:07.313907 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.313871 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-nzz85"] Jul 29 17:35:07.314297 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.314267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:07.315443 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.315421 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 29 17:35:07.315987 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.315963 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.316776 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.316197 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 17:35:07.316776 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.316323 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 17:35:07.316776 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.316361 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.316776 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.316513 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.316776 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.316573 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zzxbp\"" Jul 29 17:35:07.317130 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.316989 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 17:35:07.317175 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.317128 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m5sp6\"" Jul 29 17:35:07.317456 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.317388 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 17:35:07.317985 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.317963 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.318100 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.318082 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2"] Jul 29 17:35:07.318438 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.318087 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 29 17:35:07.318438 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.318434 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.321268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.319999 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 29 17:35:07.321268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.320257 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc"] Jul 29 17:35:07.321268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.320421 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.321268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.320687 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.321268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.320861 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.321608 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.321589 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 29 17:35:07.321702 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.321624 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.321702 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.321624 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 29 17:35:07.321864 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.321843 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-j7295"] Jul 29 17:35:07.321957 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.321886 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lwwf9\"" Jul 29 17:35:07.321957 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.321948 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.322114 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.322097 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nmscs\"" Jul 29 17:35:07.322274 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.322256 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc" Jul 29 17:35:07.323074 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.323055 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.323575 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.323551 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jswjf\"" Jul 29 17:35:07.324105 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.323773 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.324506 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.324485 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 17:35:07.324832 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.324797 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 29 17:35:07.324832 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.324834 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.325701 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.325684 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.326098 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.326080 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 29 17:35:07.326484 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.326467 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bnf6p\"" Jul 29 17:35:07.326589 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.326560 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.327247 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.327227 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69c4dc875c-gkbrj"] Jul 29 17:35:07.327511 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.327495 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.331488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.328957 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 29 17:35:07.331488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.329178 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.331488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.329729 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5gnql\"" Jul 29 17:35:07.331488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.329937 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 29 17:35:07.331488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.330140 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 29 17:35:07.331488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.331056 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8"] Jul 29 17:35:07.331488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.331168 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2"] Jul 29 17:35:07.333963 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.333939 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx"] Jul 29 17:35:07.334995 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.334107 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9"] Jul 29 17:35:07.336208 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.336189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.337419 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.337379 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw"] Jul 29 17:35:07.343631 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.343602 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 29 17:35:07.345300 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.345275 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 29 17:35:07.345520 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.345275 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.346012 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.345996 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76556c6d69-rs85g"] Jul 29 17:35:07.346213 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.346183 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lsh69"] Jul 29 17:35:07.346425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.346203 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw" Jul 29 17:35:07.346648 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.346631 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.351855 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.351804 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 29 17:35:07.352231 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.352205 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-24h9c\"" Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.352260 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.352417 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.352622 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lrmh2\"" Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.353977 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-27m9c"] Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.354687 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.356833 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.356858 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc"] Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.356888 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw"] Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.356975 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27m9c" Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.357460 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9"] Jul 29 17:35:07.357811 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.357668 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctlvv\"" Jul 29 17:35:07.358494 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.358405 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 17:35:07.358615 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.358566 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-j7295"] Jul 29 17:35:07.358889 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.358863 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 17:35:07.359134 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.359117 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 17:35:07.360145 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.359757 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-nzz85"] Jul 29 17:35:07.360145 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.359960 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 17:35:07.360794 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.360751 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lsh69"] Jul 29 17:35:07.361067 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.361047 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z85md\"" Jul 29 17:35:07.362130 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.362109 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27m9c"] Jul 29 17:35:07.372969 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.372924 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:07.421702 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.421702 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421703 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1e1a5b-4263-4e71-9691-6148749e0e67-serving-cert\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.421919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:07.421919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c1e1a5b-4263-4e71-9691-6148749e0e67-trusted-ca\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.421919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-certificates\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.421919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421832 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssb8w\" (UniqueName: \"kubernetes.io/projected/52abb246-977c-4552-95f8-fe687432925f-kube-api-access-ssb8w\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.421919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-stats-auth\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.421919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421882 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9h4t\" (UniqueName: \"kubernetes.io/projected/9c1e1a5b-4263-4e71-9691-6148749e0e67-kube-api-access-m9h4t\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.421919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee85931-a2e7-4ad3-ad32-b5b22184af25-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cjhg\" (UniqueName: \"kubernetes.io/projected/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-kube-api-access-4cjhg\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421962 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfshq\" (UniqueName: \"kubernetes.io/projected/e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd-kube-api-access-kfshq\") pod \"service-ca-operator-5d6c75f84f-gnkv2\" (UID: \"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.421988 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmtmk\" (UniqueName: \"kubernetes.io/projected/9e12b11b-e9f5-4b73-91e7-2f8f1b581579-kube-api-access-bmtmk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9\" (UID: \"9e12b11b-e9f5-4b73-91e7-2f8f1b581579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee85931-a2e7-4ad3-ad32-b5b22184af25-service-ca-bundle\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422040 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-ca-trust-extracted\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422089 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-image-registry-private-configuration\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422124 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e12b11b-e9f5-4b73-91e7-2f8f1b581579-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9\" (UID: \"9e12b11b-e9f5-4b73-91e7-2f8f1b581579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422186 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.422220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-default-certificate\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxtl\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-kube-api-access-8zxtl\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422279 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbbfl\" (UniqueName: \"kubernetes.io/projected/8b772a7a-804d-4cab-a654-9d8dbc5419c3-kube-api-access-kbbfl\") pod \"volume-data-source-validator-549c6d54cf-n7dtc\" (UID: \"8b772a7a-804d-4cab-a654-9d8dbc5419c3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gnkv2\" (UID: \"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-installation-pull-secrets\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee85931-a2e7-4ad3-ad32-b5b22184af25-tmp\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422512 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-trusted-ca\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422568 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e12b11b-e9f5-4b73-91e7-2f8f1b581579-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9\" (UID: \"9e12b11b-e9f5-4b73-91e7-2f8f1b581579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2ee85931-a2e7-4ad3-ad32-b5b22184af25-snapshots\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422640 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djptc\" (UniqueName: \"kubernetes.io/projected/399ec7b0-07c9-40ea-a355-02d958f2491c-kube-api-access-djptc\") pod \"network-check-source-7d88cb55d8-766cw\" (UID: \"399ec7b0-07c9-40ea-a355-02d958f2491c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw" Jul 29 17:35:07.422677 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:07.423124 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422696 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76qpt\" (UniqueName: \"kubernetes.io/projected/3d15c82c-3596-4a6d-9ad6-20615762b9c8-kube-api-access-76qpt\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:07.423124 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c1e1a5b-4263-4e71-9691-6148749e0e67-config\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.423124 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422752 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee85931-a2e7-4ad3-ad32-b5b22184af25-serving-cert\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.423124 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422804 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkw9q\" (UniqueName: \"kubernetes.io/projected/2ee85931-a2e7-4ad3-ad32-b5b22184af25-kube-api-access-pkw9q\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.423124 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422833 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd-config\") pod \"service-ca-operator-5d6c75f84f-gnkv2\" (UID: \"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.423124 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.422859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-bound-sa-token\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.468263 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.468223 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:07.484281 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.484243 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:35:07.484281 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.484276 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:07.484281 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.484284 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:35:07.489673 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.489644 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tsgst\"" Jul 29 17:35:07.489874 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.489777 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 17:35:07.490004 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.489810 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 17:35:07.494371 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.490635 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkqbv\"" Jul 29 17:35:07.524043 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.523953 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-installation-pull-secrets\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.524043 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee85931-a2e7-4ad3-ad32-b5b22184af25-tmp\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.524043 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524069 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-trusted-ca\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5fk\" (UniqueName: \"kubernetes.io/projected/bd5a5082-53b9-47b6-b6d8-159ed283a295-kube-api-access-2r5fk\") pod \"ingress-canary-27m9c\" (UID: \"bd5a5082-53b9-47b6-b6d8-159ed283a295\") " pod="openshift-ingress-canary/ingress-canary-27m9c" Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524130 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e12b11b-e9f5-4b73-91e7-2f8f1b581579-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9\" (UID: \"9e12b11b-e9f5-4b73-91e7-2f8f1b581579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2ee85931-a2e7-4ad3-ad32-b5b22184af25-snapshots\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djptc\" (UniqueName: \"kubernetes.io/projected/399ec7b0-07c9-40ea-a355-02d958f2491c-kube-api-access-djptc\") pod \"network-check-source-7d88cb55d8-766cw\" (UID: \"399ec7b0-07c9-40ea-a355-02d958f2491c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw" Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524221 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.524243 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:08.024222451 +0000 UTC m=+36.065107736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : configmap references non-existent config key: service-ca.crt Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76qpt\" (UniqueName: \"kubernetes.io/projected/3d15c82c-3596-4a6d-9ad6-20615762b9c8-kube-api-access-76qpt\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524346 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c1e1a5b-4263-4e71-9691-6148749e0e67-config\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.524374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524372 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee85931-a2e7-4ad3-ad32-b5b22184af25-serving-cert\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkw9q\" (UniqueName: \"kubernetes.io/projected/2ee85931-a2e7-4ad3-ad32-b5b22184af25-kube-api-access-pkw9q\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524432 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd-config\") pod \"service-ca-operator-5d6c75f84f-gnkv2\" (UID: \"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524454 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-bound-sa-token\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524463 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee85931-a2e7-4ad3-ad32-b5b22184af25-tmp\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524482 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5ac0fe1-acb0-4d20-947f-628ee312524b-config-volume\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ac0fe1-acb0-4d20-947f-628ee312524b-tmp-dir\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524595 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1e1a5b-4263-4e71-9691-6148749e0e67-serving-cert\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h59dq\" (UniqueName: \"kubernetes.io/projected/e5ac0fe1-acb0-4d20-947f-628ee312524b-kube-api-access-h59dq\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c1e1a5b-4263-4e71-9691-6148749e0e67-trusted-ca\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.524661 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.524676 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69c4dc875c-gkbrj: secret "image-registry-tls" not found Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.524735 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls podName:2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e nodeName:}" failed. No retries permitted until 2026-07-29 17:35:08.024718336 +0000 UTC m=+36.065603608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls") pod "image-registry-69c4dc875c-gkbrj" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e") : secret "image-registry-tls" not found Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-certificates\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssb8w\" (UniqueName: \"kubernetes.io/projected/52abb246-977c-4552-95f8-fe687432925f-kube-api-access-ssb8w\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.524900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524800 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-stats-auth\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9h4t\" (UniqueName: \"kubernetes.io/projected/9c1e1a5b-4263-4e71-9691-6148749e0e67-kube-api-access-m9h4t\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524851 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee85931-a2e7-4ad3-ad32-b5b22184af25-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524876 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cjhg\" (UniqueName: \"kubernetes.io/projected/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-kube-api-access-4cjhg\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524899 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfshq\" (UniqueName: \"kubernetes.io/projected/e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd-kube-api-access-kfshq\") pod \"service-ca-operator-5d6c75f84f-gnkv2\" (UID: \"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524925 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmtmk\" (UniqueName: \"kubernetes.io/projected/9e12b11b-e9f5-4b73-91e7-2f8f1b581579-kube-api-access-bmtmk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9\" (UID: \"9e12b11b-e9f5-4b73-91e7-2f8f1b581579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee85931-a2e7-4ad3-ad32-b5b22184af25-service-ca-bundle\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-ca-trust-extracted\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.524991 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-image-registry-private-configuration\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e12b11b-e9f5-4b73-91e7-2f8f1b581579-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9\" (UID: \"9e12b11b-e9f5-4b73-91e7-2f8f1b581579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525069 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525087 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-trusted-ca\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.525428 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 17:35:07.525671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525480 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2ee85931-a2e7-4ad3-ad32-b5b22184af25-snapshots\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.526385 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.525500 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls podName:3d15c82c-3596-4a6d-9ad6-20615762b9c8 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:08.025481329 +0000 UTC m=+36.066366617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls") pod "cluster-samples-operator-6748489656-lmqx8" (UID: "3d15c82c-3596-4a6d-9ad6-20615762b9c8") : secret "samples-operator-tls" not found Jul 29 17:35:07.526385 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525753 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c1e1a5b-4263-4e71-9691-6148749e0e67-trusted-ca\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.526385 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525096 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-default-certificate\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.526385 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5a5082-53b9-47b6-b6d8-159ed283a295-cert\") pod \"ingress-canary-27m9c\" (UID: \"bd5a5082-53b9-47b6-b6d8-159ed283a295\") " pod="openshift-ingress-canary/ingress-canary-27m9c" Jul 29 17:35:07.526385 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525845 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxtl\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-kube-api-access-8zxtl\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.526385 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525881 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbbfl\" (UniqueName: \"kubernetes.io/projected/8b772a7a-804d-4cab-a654-9d8dbc5419c3-kube-api-access-kbbfl\") pod \"volume-data-source-validator-549c6d54cf-n7dtc\" (UID: \"8b772a7a-804d-4cab-a654-9d8dbc5419c3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc" Jul 29 17:35:07.526385 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.525907 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gnkv2\" (UID: \"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.526385 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.526115 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c1e1a5b-4263-4e71-9691-6148749e0e67-config\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.526385 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.526294 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:07.526856 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.526707 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee85931-a2e7-4ad3-ad32-b5b22184af25-service-ca-bundle\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.528068 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.527524 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-certificates\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.528068 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.527579 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee85931-a2e7-4ad3-ad32-b5b22184af25-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.528068 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.527610 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 17:35:07.528068 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.527669 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:08.027654248 +0000 UTC m=+36.068539518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : secret "router-metrics-certs-default" not found Jul 29 17:35:07.528068 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.527726 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:07.528068 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.527763 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls podName:3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:08.027751594 +0000 UTC m=+36.068636863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2lx" (UID: "3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12") : secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:07.528068 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.528000 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e12b11b-e9f5-4b73-91e7-2f8f1b581579-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9\" (UID: \"9e12b11b-e9f5-4b73-91e7-2f8f1b581579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.528512 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.528345 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-ca-trust-extracted\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.528512 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.528444 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd-config\") pod \"service-ca-operator-5d6c75f84f-gnkv2\" (UID: \"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.530000 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.529952 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1e1a5b-4263-4e71-9691-6148749e0e67-serving-cert\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.530662 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.530638 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee85931-a2e7-4ad3-ad32-b5b22184af25-serving-cert\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.530867 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.530652 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd-serving-cert\") pod \"service-ca-operator-5d6c75f84f-gnkv2\" (UID: \"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.530976 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.530663 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e12b11b-e9f5-4b73-91e7-2f8f1b581579-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9\" (UID: \"9e12b11b-e9f5-4b73-91e7-2f8f1b581579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.530976 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.530921 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-default-certificate\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.531158 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.531135 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-image-registry-private-configuration\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.532141 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.532114 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-installation-pull-secrets\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.532475 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.532459 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-stats-auth\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.542389 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.542355 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmtmk\" (UniqueName: \"kubernetes.io/projected/9e12b11b-e9f5-4b73-91e7-2f8f1b581579-kube-api-access-bmtmk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9\" (UID: \"9e12b11b-e9f5-4b73-91e7-2f8f1b581579\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.542662 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.542622 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssb8w\" (UniqueName: \"kubernetes.io/projected/52abb246-977c-4552-95f8-fe687432925f-kube-api-access-ssb8w\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:07.543201 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.543171 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76qpt\" (UniqueName: \"kubernetes.io/projected/3d15c82c-3596-4a6d-9ad6-20615762b9c8-kube-api-access-76qpt\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:07.544204 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.544180 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkw9q\" (UniqueName: \"kubernetes.io/projected/2ee85931-a2e7-4ad3-ad32-b5b22184af25-kube-api-access-pkw9q\") pod \"insights-operator-5885fdb759-j7295\" (UID: \"2ee85931-a2e7-4ad3-ad32-b5b22184af25\") " pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.550615 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.550585 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfshq\" (UniqueName: \"kubernetes.io/projected/e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd-kube-api-access-kfshq\") pod \"service-ca-operator-5d6c75f84f-gnkv2\" (UID: \"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.551370 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.551170 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbbfl\" (UniqueName: \"kubernetes.io/projected/8b772a7a-804d-4cab-a654-9d8dbc5419c3-kube-api-access-kbbfl\") pod \"volume-data-source-validator-549c6d54cf-n7dtc\" (UID: \"8b772a7a-804d-4cab-a654-9d8dbc5419c3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc" Jul 29 17:35:07.551690 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.551671 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9h4t\" (UniqueName: \"kubernetes.io/projected/9c1e1a5b-4263-4e71-9691-6148749e0e67-kube-api-access-m9h4t\") pod \"console-operator-584dcb6b54-nzz85\" (UID: \"9c1e1a5b-4263-4e71-9691-6148749e0e67\") " pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.551767 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.551693 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djptc\" (UniqueName: \"kubernetes.io/projected/399ec7b0-07c9-40ea-a355-02d958f2491c-kube-api-access-djptc\") pod \"network-check-source-7d88cb55d8-766cw\" (UID: \"399ec7b0-07c9-40ea-a355-02d958f2491c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw" Jul 29 17:35:07.551767 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.551672 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-bound-sa-token\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.553165 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.553082 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxtl\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-kube-api-access-8zxtl\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:07.553255 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.553220 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cjhg\" (UniqueName: \"kubernetes.io/projected/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-kube-api-access-4cjhg\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:07.569215 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.569180 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:07.627016 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.626970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5ac0fe1-acb0-4d20-947f-628ee312524b-config-volume\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.627016 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.627012 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ac0fe1-acb0-4d20-947f-628ee312524b-tmp-dir\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.627228 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.627063 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h59dq\" (UniqueName: \"kubernetes.io/projected/e5ac0fe1-acb0-4d20-947f-628ee312524b-kube-api-access-h59dq\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.627228 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.627108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.627228 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.627129 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5a5082-53b9-47b6-b6d8-159ed283a295-cert\") pod \"ingress-canary-27m9c\" (UID: \"bd5a5082-53b9-47b6-b6d8-159ed283a295\") " pod="openshift-ingress-canary/ingress-canary-27m9c" Jul 29 17:35:07.627228 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.627172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5fk\" (UniqueName: \"kubernetes.io/projected/bd5a5082-53b9-47b6-b6d8-159ed283a295-kube-api-access-2r5fk\") pod \"ingress-canary-27m9c\" (UID: \"bd5a5082-53b9-47b6-b6d8-159ed283a295\") " pod="openshift-ingress-canary/ingress-canary-27m9c" Jul 29 17:35:07.627397 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.627293 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:07.627397 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:07.627380 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls podName:e5ac0fe1-acb0-4d20-947f-628ee312524b nodeName:}" failed. No retries permitted until 2026-07-29 17:35:08.127359214 +0000 UTC m=+36.168244495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls") pod "dns-default-lsh69" (UID: "e5ac0fe1-acb0-4d20-947f-628ee312524b") : secret "dns-default-metrics-tls" not found Jul 29 17:35:07.627797 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.627777 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ac0fe1-acb0-4d20-947f-628ee312524b-tmp-dir\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.628020 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.627998 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5ac0fe1-acb0-4d20-947f-628ee312524b-config-volume\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.630207 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.630182 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd5a5082-53b9-47b6-b6d8-159ed283a295-cert\") pod \"ingress-canary-27m9c\" (UID: \"bd5a5082-53b9-47b6-b6d8-159ed283a295\") " pod="openshift-ingress-canary/ingress-canary-27m9c" Jul 29 17:35:07.636365 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.636343 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h59dq\" (UniqueName: \"kubernetes.io/projected/e5ac0fe1-acb0-4d20-947f-628ee312524b-kube-api-access-h59dq\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:07.636845 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.636828 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5fk\" (UniqueName: \"kubernetes.io/projected/bd5a5082-53b9-47b6-b6d8-159ed283a295-kube-api-access-2r5fk\") pod \"ingress-canary-27m9c\" (UID: \"bd5a5082-53b9-47b6-b6d8-159ed283a295\") " pod="openshift-ingress-canary/ingress-canary-27m9c" Jul 29 17:35:07.675017 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.674983 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:07.682175 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.682145 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" Jul 29 17:35:07.689158 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.689132 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc" Jul 29 17:35:07.696857 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.696824 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-j7295" Jul 29 17:35:07.704570 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.704544 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" Jul 29 17:35:07.712321 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.712287 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw" Jul 29 17:35:07.728233 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:07.728204 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27m9c" Jul 29 17:35:08.031337 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.031283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:08.031518 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.031357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:08.031518 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.031414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:08.031518 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031431 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:08.031518 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031455 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69c4dc875c-gkbrj: secret "image-registry-tls" not found Jul 29 17:35:08.031518 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.031458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:08.031518 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031517 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls podName:2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e nodeName:}" failed. No retries permitted until 2026-07-29 17:35:09.031495064 +0000 UTC m=+37.072380354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls") pod "image-registry-69c4dc875c-gkbrj" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e") : secret "image-registry-tls" not found Jul 29 17:35:08.031804 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031519 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 17:35:08.031804 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031578 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 17:35:08.031804 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031579 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls podName:3d15c82c-3596-4a6d-9ad6-20615762b9c8 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:09.031562618 +0000 UTC m=+37.072447902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls") pod "cluster-samples-operator-6748489656-lmqx8" (UID: "3d15c82c-3596-4a6d-9ad6-20615762b9c8") : secret "samples-operator-tls" not found Jul 29 17:35:08.031804 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031645 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:09.031630003 +0000 UTC m=+37.072515287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : secret "router-metrics-certs-default" not found Jul 29 17:35:08.031804 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031644 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:08.031804 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.031663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:08.031804 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031684 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls podName:3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:09.031671999 +0000 UTC m=+37.072557298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2lx" (UID: "3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12") : secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:08.031804 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.031745 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:09.031732059 +0000 UTC m=+37.072617353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : configmap references non-existent config key: service-ca.crt Jul 29 17:35:08.132405 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.132363 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:08.132574 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.132536 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:08.132626 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:08.132604 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls podName:e5ac0fe1-acb0-4d20-947f-628ee312524b nodeName:}" failed. No retries permitted until 2026-07-29 17:35:09.132583276 +0000 UTC m=+37.173468564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls") pod "dns-default-lsh69" (UID: "e5ac0fe1-acb0-4d20-947f-628ee312524b") : secret "dns-default-metrics-tls" not found Jul 29 17:35:08.909056 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.908747 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-j7295"] Jul 29 17:35:08.915643 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.915615 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27m9c"] Jul 29 17:35:08.923819 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.923700 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-nzz85"] Jul 29 17:35:08.925430 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.925381 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2"] Jul 29 17:35:08.926171 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.926147 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc"] Jul 29 17:35:08.933735 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.933563 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9"] Jul 29 17:35:08.947137 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:08.947111 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw"] Jul 29 17:35:08.950927 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:08.950902 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e12b11b_e9f5_4b73_91e7_2f8f1b581579.slice/crio-4bc86000e311e5ae28a4eb17c5708fe565cdc7f99ec72c3620a5c2de3d6ab0a3 WatchSource:0}: Error finding container 4bc86000e311e5ae28a4eb17c5708fe565cdc7f99ec72c3620a5c2de3d6ab0a3: Status 404 returned error can't find the container with id 4bc86000e311e5ae28a4eb17c5708fe565cdc7f99ec72c3620a5c2de3d6ab0a3 Jul 29 17:35:08.951718 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:08.951686 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17a1e08_4d9c_45a6_b015_7c32a6dc1dfd.slice/crio-074e2f8d74cd56a5b062dd3d651ea2d390d9d36986ac8db5f5373e354c0f5f17 WatchSource:0}: Error finding container 074e2f8d74cd56a5b062dd3d651ea2d390d9d36986ac8db5f5373e354c0f5f17: Status 404 returned error can't find the container with id 074e2f8d74cd56a5b062dd3d651ea2d390d9d36986ac8db5f5373e354c0f5f17 Jul 29 17:35:08.955292 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:08.954994 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee85931_a2e7_4ad3_ad32_b5b22184af25.slice/crio-2331e87378e41958e80d82dfac3073b92007be6ee910117a1031156e118d6f98 WatchSource:0}: Error finding container 2331e87378e41958e80d82dfac3073b92007be6ee910117a1031156e118d6f98: Status 404 returned error can't find the container with id 2331e87378e41958e80d82dfac3073b92007be6ee910117a1031156e118d6f98 Jul 29 17:35:09.044746 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.044708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:09.044746 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.044749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:09.044960 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.044846 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 17:35:09.044960 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.044852 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:09.044960 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.044872 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69c4dc875c-gkbrj: secret "image-registry-tls" not found Jul 29 17:35:09.044960 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.044882 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:09.044960 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.044895 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls podName:3d15c82c-3596-4a6d-9ad6-20615762b9c8 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:11.044882024 +0000 UTC m=+39.085767323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls") pod "cluster-samples-operator-6748489656-lmqx8" (UID: "3d15c82c-3596-4a6d-9ad6-20615762b9c8") : secret "samples-operator-tls" not found Jul 29 17:35:09.044960 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.044929 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls podName:2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e nodeName:}" failed. No retries permitted until 2026-07-29 17:35:11.044913894 +0000 UTC m=+39.085799166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls") pod "image-registry-69c4dc875c-gkbrj" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e") : secret "image-registry-tls" not found Jul 29 17:35:09.044960 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.044960 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:09.044960 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.044963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:09.045226 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.044988 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls podName:3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:11.044976937 +0000 UTC m=+39.085862205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2lx" (UID: "3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12") : secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:09.045226 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.045030 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 17:35:09.045226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.045036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:09.045226 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.045076 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:11.045065854 +0000 UTC m=+39.085951136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : secret "router-metrics-certs-default" not found Jul 29 17:35:09.045226 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.045112 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:11.045105185 +0000 UTC m=+39.085990453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : configmap references non-existent config key: service-ca.crt Jul 29 17:35:09.145855 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.145766 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:09.145990 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.145926 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:09.146043 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:09.145993 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls podName:e5ac0fe1-acb0-4d20-947f-628ee312524b nodeName:}" failed. No retries permitted until 2026-07-29 17:35:11.145977261 +0000 UTC m=+39.186862542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls") pod "dns-default-lsh69" (UID: "e5ac0fe1-acb0-4d20-947f-628ee312524b") : secret "dns-default-metrics-tls" not found Jul 29 17:35:09.188441 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.188402 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:09.248252 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.248221 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:09.665175 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.665121 2560 generic.go:356] "Generic (PLEG): container finished" podID="d54bc7ed-6203-453b-81e7-8e0170ffa718" containerID="656238a2020d5b0cf9af48bde8b798e355dee8d100010d254e27731c30125e47" exitCode=0 Jul 29 17:35:09.665620 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.665346 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" event={"ID":"d54bc7ed-6203-453b-81e7-8e0170ffa718","Type":"ContainerDied","Data":"656238a2020d5b0cf9af48bde8b798e355dee8d100010d254e27731c30125e47"} Jul 29 17:35:09.669603 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.669560 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw" event={"ID":"399ec7b0-07c9-40ea-a355-02d958f2491c","Type":"ContainerStarted","Data":"1a5b4e74bfe0e555b1c0ec190d3886053a6c6f93d765c8c23f4c3fc693a57f2a"} Jul 29 17:35:09.673067 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.673011 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27m9c" event={"ID":"bd5a5082-53b9-47b6-b6d8-159ed283a295","Type":"ContainerStarted","Data":"fde7191188b44b37149e79b28ce583ec9172ec8a96e234616f3833111a64b0f3"} Jul 29 17:35:09.676505 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.676319 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-j7295" event={"ID":"2ee85931-a2e7-4ad3-ad32-b5b22184af25","Type":"ContainerStarted","Data":"2331e87378e41958e80d82dfac3073b92007be6ee910117a1031156e118d6f98"} Jul 29 17:35:09.678384 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.678271 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" event={"ID":"9e12b11b-e9f5-4b73-91e7-2f8f1b581579","Type":"ContainerStarted","Data":"4bc86000e311e5ae28a4eb17c5708fe565cdc7f99ec72c3620a5c2de3d6ab0a3"} Jul 29 17:35:09.680397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.680322 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" event={"ID":"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd","Type":"ContainerStarted","Data":"074e2f8d74cd56a5b062dd3d651ea2d390d9d36986ac8db5f5373e354c0f5f17"} Jul 29 17:35:09.682879 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.682853 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" event={"ID":"9c1e1a5b-4263-4e71-9691-6148749e0e67","Type":"ContainerStarted","Data":"bb5eb6ef1df077f98116dd9c19ecc2e0192aa90b7dfd3289a4fc8564c1b121d3"} Jul 29 17:35:09.685788 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:09.685758 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc" event={"ID":"8b772a7a-804d-4cab-a654-9d8dbc5419c3","Type":"ContainerStarted","Data":"94f49f00fad4321b0ded2a73889baa1b65fc6c125fb2276a2c6496177462e43d"} Jul 29 17:35:10.702394 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:10.702356 2560 generic.go:356] "Generic (PLEG): container finished" podID="d54bc7ed-6203-453b-81e7-8e0170ffa718" containerID="d1cf5748e35eec59362fe95f0b77f3ea0e4f335f858a00451afb7902e8dd2fcf" exitCode=0 Jul 29 17:35:10.702888 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:10.702428 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" event={"ID":"d54bc7ed-6203-453b-81e7-8e0170ffa718","Type":"ContainerDied","Data":"d1cf5748e35eec59362fe95f0b77f3ea0e4f335f858a00451afb7902e8dd2fcf"} Jul 29 17:35:10.998545 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:10.998426 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:11.067919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.067642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:11.067919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.067689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:11.067919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.067759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:11.067919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.067799 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:11.067919 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.067859 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.068070 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:15.068051382 +0000 UTC m=+43.108936663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : configmap references non-existent config key: service-ca.crt Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.068572 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.068591 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69c4dc875c-gkbrj: secret "image-registry-tls" not found Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.068643 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls podName:2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e nodeName:}" failed. No retries permitted until 2026-07-29 17:35:15.068623349 +0000 UTC m=+43.109508636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls") pod "image-registry-69c4dc875c-gkbrj" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e") : secret "image-registry-tls" not found Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.068886 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.068923 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls podName:3d15c82c-3596-4a6d-9ad6-20615762b9c8 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:15.068911188 +0000 UTC m=+43.109796473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls") pod "cluster-samples-operator-6748489656-lmqx8" (UID: "3d15c82c-3596-4a6d-9ad6-20615762b9c8") : secret "samples-operator-tls" not found Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.068980 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.069013 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls podName:3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:15.069002203 +0000 UTC m=+43.109887484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2lx" (UID: "3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12") : secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.069066 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 17:35:11.069480 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.069099 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:15.06908708 +0000 UTC m=+43.109972361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : secret "router-metrics-certs-default" not found Jul 29 17:35:11.100860 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.100819 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:11.168818 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.168776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:11.169431 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.168981 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:11.169431 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:11.169052 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls podName:e5ac0fe1-acb0-4d20-947f-628ee312524b nodeName:}" failed. No retries permitted until 2026-07-29 17:35:15.169031678 +0000 UTC m=+43.209916957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls") pod "dns-default-lsh69" (UID: "e5ac0fe1-acb0-4d20-947f-628ee312524b") : secret "dns-default-metrics-tls" not found Jul 29 17:35:11.710286 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.710050 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc" event={"ID":"8b772a7a-804d-4cab-a654-9d8dbc5419c3","Type":"ContainerStarted","Data":"c3faa94d351f61feaf90c83af8e9a28f7b211a196ccee561a3312861db31913f"} Jul 29 17:35:11.715621 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.715589 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" event={"ID":"d54bc7ed-6203-453b-81e7-8e0170ffa718","Type":"ContainerStarted","Data":"7d8411dac71eb4310f6f988066f442cd290fc9c92b313b41bca9efd1b42c8418"} Jul 29 17:35:11.726011 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.725957 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-n7dtc" podStartSLOduration=11.336938 podStartE2EDuration="13.725937253s" totalImagesPullingTime="2.388999253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:11.724961503 +0000 UTC m=+39.765846793" watchObservedRunningTime="2026-07-29 17:35:11.725937253 +0000 UTC m=+39.766822543" Jul 29 17:35:11.745633 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.745542 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8dxl6" podStartSLOduration=9.980456854 podStartE2EDuration="39.74552747s" totalImagesPullingTime="29.765070616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:11.744800579 +0000 UTC m=+39.785685900" watchObservedRunningTime="2026-07-29 17:35:11.74552747 +0000 UTC m=+39.786412761" Jul 29 17:35:11.868235 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.868142 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:11.949688 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:11.949615 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" limit=1024 Jul 29 17:35:15.103877 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:15.103839 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:15.103877 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:15.103890 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:15.103945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:15.103979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104024 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104045 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69c4dc875c-gkbrj: secret "image-registry-tls" not found Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104087 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104090 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104099 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104143 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.104124302 +0000 UTC m=+51.145009570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : secret "router-metrics-certs-default" not found Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:15.104165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104173 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls podName:3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.104157587 +0000 UTC m=+51.145042875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2lx" (UID: "3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12") : secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104196 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls podName:2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.104187397 +0000 UTC m=+51.145072670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls") pod "image-registry-69c4dc875c-gkbrj" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e") : secret "image-registry-tls" not found Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104211 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls podName:3d15c82c-3596-4a6d-9ad6-20615762b9c8 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.104203484 +0000 UTC m=+51.145088753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls") pod "cluster-samples-operator-6748489656-lmqx8" (UID: "3d15c82c-3596-4a6d-9ad6-20615762b9c8") : secret "samples-operator-tls" not found Jul 29 17:35:15.104618 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.104236 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.104225004 +0000 UTC m=+51.145110306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : configmap references non-existent config key: service-ca.crt Jul 29 17:35:15.205210 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:15.205156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:15.205419 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.205339 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:15.205419 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:15.205410 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls podName:e5ac0fe1-acb0-4d20-947f-628ee312524b nodeName:}" failed. No retries permitted until 2026-07-29 17:35:23.20539328 +0000 UTC m=+51.246278569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls") pod "dns-default-lsh69" (UID: "e5ac0fe1-acb0-4d20-947f-628ee312524b") : secret "dns-default-metrics-tls" not found Jul 29 17:35:17.740038 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.739996 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw" event={"ID":"399ec7b0-07c9-40ea-a355-02d958f2491c","Type":"ContainerStarted","Data":"cb0765c8897e32a162bbea3453d3e66a68cc138cdda7fdd5401ce209f56c4120"} Jul 29 17:35:17.741916 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.741881 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27m9c" event={"ID":"bd5a5082-53b9-47b6-b6d8-159ed283a295","Type":"ContainerStarted","Data":"3d4258c1602bcaf83cac142f455c8c0d9cb9e795bf46994ea1173ddcaf23b307"} Jul 29 17:35:17.743728 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.743699 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-j7295" event={"ID":"2ee85931-a2e7-4ad3-ad32-b5b22184af25","Type":"ContainerStarted","Data":"9d986d7af23e468f538a5b0df7ee42455ed1fcc313b2b9bad5ab9e48cc41a40a"} Jul 29 17:35:17.745511 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.745485 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" event={"ID":"9e12b11b-e9f5-4b73-91e7-2f8f1b581579","Type":"ContainerStarted","Data":"48ff4edeabf15e80ea9028ceb21041c39b3242d551b25775aff5cc9cb211d882"} Jul 29 17:35:17.747198 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.747175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" event={"ID":"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd","Type":"ContainerStarted","Data":"cd8de46e197882ae8999bfc007ce8495e30a6b2a7699ee0114c6cf48d2a91247"} Jul 29 17:35:17.748988 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.748969 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/0.log" Jul 29 17:35:17.749104 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.749008 2560 generic.go:356] "Generic (PLEG): container finished" podID="9c1e1a5b-4263-4e71-9691-6148749e0e67" containerID="6148708e21c73e1517c9c86b32ca5cd9c781672b6416127a2bab16cbeb1cd4d4" exitCode=255 Jul 29 17:35:17.749104 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.749045 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" event={"ID":"9c1e1a5b-4263-4e71-9691-6148749e0e67","Type":"ContainerDied","Data":"6148708e21c73e1517c9c86b32ca5cd9c781672b6416127a2bab16cbeb1cd4d4"} Jul 29 17:35:17.749238 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.749224 2560 scope.go:117] "RemoveContainer" containerID="6148708e21c73e1517c9c86b32ca5cd9c781672b6416127a2bab16cbeb1cd4d4" Jul 29 17:35:17.755772 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.755726 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-766cw" podStartSLOduration=7.707116726 podStartE2EDuration="15.755711447s" totalImagesPullingTime="8.048594721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:17.754941257 +0000 UTC m=+45.795826543" watchObservedRunningTime="2026-07-29 17:35:17.755711447 +0000 UTC m=+45.796596718" Jul 29 17:35:17.773247 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.773176 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-j7295" podStartSLOduration=11.725823180999999 podStartE2EDuration="19.773154101s" totalImagesPullingTime="8.04733092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:17.772401715 +0000 UTC m=+45.813287030" watchObservedRunningTime="2026-07-29 17:35:17.773154101 +0000 UTC m=+45.814039394" Jul 29 17:35:17.792265 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.792202 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" podStartSLOduration=10.741879062 podStartE2EDuration="18.792178482s" totalImagesPullingTime="8.05029942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:17.79147357 +0000 UTC m=+45.832358860" watchObservedRunningTime="2026-07-29 17:35:17.792178482 +0000 UTC m=+45.833063753" Jul 29 17:35:17.813253 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.813187 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-27m9c" podStartSLOduration=2.766276708 podStartE2EDuration="10.813161222s" totalImagesPullingTime="8.046884514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:17.811039396 +0000 UTC m=+45.851924688" watchObservedRunningTime="2026-07-29 17:35:17.813161222 +0000 UTC m=+45.854046510" Jul 29 17:35:17.845141 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:17.844383 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" podStartSLOduration=11.794557285 podStartE2EDuration="19.844357116s" totalImagesPullingTime="8.049799831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:17.843332438 +0000 UTC m=+45.884217757" watchObservedRunningTime="2026-07-29 17:35:17.844357116 +0000 UTC m=+45.885242423" Jul 29 17:35:18.490991 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.490946 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf"] Jul 29 17:35:18.525696 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.525660 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf"] Jul 29 17:35:18.525861 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.525789 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf" Jul 29 17:35:18.532593 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.532562 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 29 17:35:18.532748 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.532562 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 29 17:35:18.535386 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.535362 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6q7w\" (UniqueName: \"kubernetes.io/projected/4e98989f-b739-49c8-a63b-64a7492e4e7d-kube-api-access-r6q7w\") pod \"migrator-6865c9967-5sqjf\" (UID: \"4e98989f-b739-49c8-a63b-64a7492e4e7d\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf" Jul 29 17:35:18.536764 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.536743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fmzgt\"" Jul 29 17:35:18.636965 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.636916 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6q7w\" (UniqueName: \"kubernetes.io/projected/4e98989f-b739-49c8-a63b-64a7492e4e7d-kube-api-access-r6q7w\") pod \"migrator-6865c9967-5sqjf\" (UID: \"4e98989f-b739-49c8-a63b-64a7492e4e7d\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf" Jul 29 17:35:18.647806 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.647773 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6q7w\" (UniqueName: \"kubernetes.io/projected/4e98989f-b739-49c8-a63b-64a7492e4e7d-kube-api-access-r6q7w\") pod \"migrator-6865c9967-5sqjf\" (UID: \"4e98989f-b739-49c8-a63b-64a7492e4e7d\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf" Jul 29 17:35:18.754291 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.754265 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/1.log" Jul 29 17:35:18.754735 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.754709 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/0.log" Jul 29 17:35:18.754795 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.754739 2560 generic.go:356] "Generic (PLEG): container finished" podID="9c1e1a5b-4263-4e71-9691-6148749e0e67" containerID="2a22ee740e9a783987dd75023602b7893e4a0227d9c76e9be627e90876da9a14" exitCode=255 Jul 29 17:35:18.754795 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.754775 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" event={"ID":"9c1e1a5b-4263-4e71-9691-6148749e0e67","Type":"ContainerDied","Data":"2a22ee740e9a783987dd75023602b7893e4a0227d9c76e9be627e90876da9a14"} Jul 29 17:35:18.754889 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.754859 2560 scope.go:117] "RemoveContainer" containerID="6148708e21c73e1517c9c86b32ca5cd9c781672b6416127a2bab16cbeb1cd4d4" Jul 29 17:35:18.755135 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.755113 2560 scope.go:117] "RemoveContainer" containerID="2a22ee740e9a783987dd75023602b7893e4a0227d9c76e9be627e90876da9a14" Jul 29 17:35:18.755349 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:18.755296 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-nzz85_openshift-console-operator(9c1e1a5b-4263-4e71-9691-6148749e0e67)\"" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" podUID="9c1e1a5b-4263-4e71-9691-6148749e0e67" Jul 29 17:35:18.835262 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.835225 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf" Jul 29 17:35:18.853574 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.853509 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tc7tr"] Jul 29 17:35:18.872747 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.872714 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tc7tr"] Jul 29 17:35:18.872909 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.872834 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:18.875970 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.875949 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5kx8\"" Jul 29 17:35:18.876160 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.876149 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 17:35:18.876206 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.876183 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 17:35:18.943143 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.943110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f43b1001-8435-4d80-b26e-40a485fc9aba-crio-socket\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:18.943329 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.943154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpzgn\" (UniqueName: \"kubernetes.io/projected/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-api-access-zpzgn\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:18.943329 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.943276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:18.943428 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.943349 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f43b1001-8435-4d80-b26e-40a485fc9aba-data-volume\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:18.943428 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:18.943383 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.005858 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.005759 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf"] Jul 29 17:35:19.044560 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.044533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f43b1001-8435-4d80-b26e-40a485fc9aba-crio-socket\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.044693 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.044567 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpzgn\" (UniqueName: \"kubernetes.io/projected/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-api-access-zpzgn\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.044693 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.044664 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f43b1001-8435-4d80-b26e-40a485fc9aba-crio-socket\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.044776 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.044711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.044776 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.044757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f43b1001-8435-4d80-b26e-40a485fc9aba-data-volume\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.044852 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.044779 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.044852 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:19.044803 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:19.044927 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:19.044874 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls podName:f43b1001-8435-4d80-b26e-40a485fc9aba nodeName:}" failed. No retries permitted until 2026-07-29 17:35:19.544857564 +0000 UTC m=+47.585742836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tc7tr" (UID: "f43b1001-8435-4d80-b26e-40a485fc9aba") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:19.044927 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:19.044897 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 17:35:19.045008 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:19.044963 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm podName:f43b1001-8435-4d80-b26e-40a485fc9aba nodeName:}" failed. No retries permitted until 2026-07-29 17:35:19.544945891 +0000 UTC m=+47.585831179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tc7tr" (UID: "f43b1001-8435-4d80-b26e-40a485fc9aba") : configmap "kube-rbac-proxy" not found Jul 29 17:35:19.045111 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.045095 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f43b1001-8435-4d80-b26e-40a485fc9aba-data-volume\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.054471 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.054439 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpzgn\" (UniqueName: \"kubernetes.io/projected/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-api-access-zpzgn\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.550486 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.550443 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.550639 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:19.550577 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 17:35:19.550676 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.550633 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:19.550676 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:19.550654 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm podName:f43b1001-8435-4d80-b26e-40a485fc9aba nodeName:}" failed. No retries permitted until 2026-07-29 17:35:20.550632971 +0000 UTC m=+48.591518262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tc7tr" (UID: "f43b1001-8435-4d80-b26e-40a485fc9aba") : configmap "kube-rbac-proxy" not found Jul 29 17:35:19.550770 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:19.550722 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:19.550801 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:19.550776 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls podName:f43b1001-8435-4d80-b26e-40a485fc9aba nodeName:}" failed. No retries permitted until 2026-07-29 17:35:20.550763219 +0000 UTC m=+48.591648506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tc7tr" (UID: "f43b1001-8435-4d80-b26e-40a485fc9aba") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:19.760426 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.760399 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/1.log" Jul 29 17:35:19.760888 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.760758 2560 scope.go:117] "RemoveContainer" containerID="2a22ee740e9a783987dd75023602b7893e4a0227d9c76e9be627e90876da9a14" Jul 29 17:35:19.760937 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:19.760920 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-nzz85_openshift-console-operator(9c1e1a5b-4263-4e71-9691-6148749e0e67)\"" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" podUID="9c1e1a5b-4263-4e71-9691-6148749e0e67" Jul 29 17:35:19.761763 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:19.761737 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf" event={"ID":"4e98989f-b739-49c8-a63b-64a7492e4e7d","Type":"ContainerStarted","Data":"f80b38d0a8b118d96459ff576ccb4f06abbff7a1039c7a43b17e2ea425b47a4f"} Jul 29 17:35:20.559117 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:20.559074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:20.559340 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:20.559127 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:20.559340 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:20.559205 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 17:35:20.559340 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:20.559237 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:20.559340 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:20.559259 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm podName:f43b1001-8435-4d80-b26e-40a485fc9aba nodeName:}" failed. No retries permitted until 2026-07-29 17:35:22.559241648 +0000 UTC m=+50.600126936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tc7tr" (UID: "f43b1001-8435-4d80-b26e-40a485fc9aba") : configmap "kube-rbac-proxy" not found Jul 29 17:35:20.559340 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:20.559322 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls podName:f43b1001-8435-4d80-b26e-40a485fc9aba nodeName:}" failed. No retries permitted until 2026-07-29 17:35:22.559288226 +0000 UTC m=+50.600173512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tc7tr" (UID: "f43b1001-8435-4d80-b26e-40a485fc9aba") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:20.857104 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:20.857037 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s66k8_1d3beb8a-488b-441f-b7d4-01ce783ad5d5/dns-node-resolver/0.log" Jul 29 17:35:21.656589 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:21.656561 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j9sg2_23725b74-f8de-4145-85bc-574758306a84/node-ca/0.log" Jul 29 17:35:21.770430 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:21.770391 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf" event={"ID":"4e98989f-b739-49c8-a63b-64a7492e4e7d","Type":"ContainerStarted","Data":"a45a342b1bcf4aaad3926a2effbb722f97ce1ee545ba76684fda980738b8ce66"} Jul 29 17:35:21.770619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:21.770448 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf" event={"ID":"4e98989f-b739-49c8-a63b-64a7492e4e7d","Type":"ContainerStarted","Data":"b509756e49cd11309018e12adbab7387f5aeeda1a454004d2ef17998fa87d8fa"} Jul 29 17:35:21.786386 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:21.786300 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5sqjf" podStartSLOduration=1.900022723 podStartE2EDuration="3.786278887s" totalImagesPullingTime="1.886256164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:21.786194274 +0000 UTC m=+49.827079565" watchObservedRunningTime="2026-07-29 17:35:21.786278887 +0000 UTC m=+49.827164178" Jul 29 17:35:22.455852 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:22.455821 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27m9c_bd5a5082-53b9-47b6-b6d8-159ed283a295/serve-healthcheck-canary/0.log" Jul 29 17:35:22.574692 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:22.574647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:22.574692 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:22.574696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:22.574905 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:22.574767 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 17:35:22.574905 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:22.574809 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:22.574905 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:22.574818 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm podName:f43b1001-8435-4d80-b26e-40a485fc9aba nodeName:}" failed. No retries permitted until 2026-07-29 17:35:26.57480336 +0000 UTC m=+54.615688642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tc7tr" (UID: "f43b1001-8435-4d80-b26e-40a485fc9aba") : configmap "kube-rbac-proxy" not found Jul 29 17:35:22.575003 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:22.574917 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls podName:f43b1001-8435-4d80-b26e-40a485fc9aba nodeName:}" failed. No retries permitted until 2026-07-29 17:35:26.574904796 +0000 UTC m=+54.615790067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tc7tr" (UID: "f43b1001-8435-4d80-b26e-40a485fc9aba") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:22.656352 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:22.656299 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-5sqjf_4e98989f-b739-49c8-a63b-64a7492e4e7d/migrator/0.log" Jul 29 17:35:22.857100 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:22.857067 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-5sqjf_4e98989f-b739-49c8-a63b-64a7492e4e7d/graceful-termination/0.log" Jul 29 17:35:23.057714 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:23.057680 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9_9e12b11b-e9f5-4b73-91e7-2f8f1b581579/kube-storage-version-migrator-operator/0.log" Jul 29 17:35:23.181282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:23.181184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:23.181282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:23.181253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:23.181282 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:23.181280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:23.181341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181378 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181399 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:23.181430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181450 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181456 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls podName:3d15c82c-3596-4a6d-9ad6-20615762b9c8 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:39.181434794 +0000 UTC m=+67.222320078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls") pod "cluster-samples-operator-6748489656-lmqx8" (UID: "3d15c82c-3596-4a6d-9ad6-20615762b9c8") : secret "samples-operator-tls" not found Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181505 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181512 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls podName:3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12 nodeName:}" failed. No retries permitted until 2026-07-29 17:35:39.181502776 +0000 UTC m=+67.222388049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2lx" (UID: "3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12") : secret "cluster-monitoring-operator-tls" not found Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181518 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69c4dc875c-gkbrj: secret "image-registry-tls" not found Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181528 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:39.181519458 +0000 UTC m=+67.222404765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : secret "router-metrics-certs-default" not found Jul 29 17:35:23.181584 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181550 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls podName:2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e nodeName:}" failed. No retries permitted until 2026-07-29 17:35:39.181537922 +0000 UTC m=+67.222423192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls") pod "image-registry-69c4dc875c-gkbrj" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e") : secret "image-registry-tls" not found Jul 29 17:35:23.181948 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.181591 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle podName:52abb246-977c-4552-95f8-fe687432925f nodeName:}" failed. No retries permitted until 2026-07-29 17:35:39.181571866 +0000 UTC m=+67.222457152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle") pod "router-default-76556c6d69-rs85g" (UID: "52abb246-977c-4552-95f8-fe687432925f") : configmap references non-existent config key: service-ca.crt Jul 29 17:35:23.282423 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:23.282380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:23.282589 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.282537 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 17:35:23.282657 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:23.282600 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls podName:e5ac0fe1-acb0-4d20-947f-628ee312524b nodeName:}" failed. No retries permitted until 2026-07-29 17:35:39.28258496 +0000 UTC m=+67.323470227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls") pod "dns-default-lsh69" (UID: "e5ac0fe1-acb0-4d20-947f-628ee312524b") : secret "dns-default-metrics-tls" not found Jul 29 17:35:26.611143 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:26.611094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:26.611143 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:26.611147 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:26.611769 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:26.611266 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 17:35:26.611769 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:26.611371 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls podName:f43b1001-8435-4d80-b26e-40a485fc9aba nodeName:}" failed. No retries permitted until 2026-07-29 17:35:34.611347875 +0000 UTC m=+62.652233164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tc7tr" (UID: "f43b1001-8435-4d80-b26e-40a485fc9aba") : secret "insights-runtime-extractor-tls" not found Jul 29 17:35:26.611862 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:26.611843 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f43b1001-8435-4d80-b26e-40a485fc9aba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:27.675753 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:27.675706 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:27.676268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:27.675784 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:27.676268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:27.676241 2560 scope.go:117] "RemoveContainer" containerID="2a22ee740e9a783987dd75023602b7893e4a0227d9c76e9be627e90876da9a14" Jul 29 17:35:27.676504 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:35:27.676479 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-nzz85_openshift-console-operator(9c1e1a5b-4263-4e71-9691-6148749e0e67)\"" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" podUID="9c1e1a5b-4263-4e71-9691-6148749e0e67" Jul 29 17:35:32.658199 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:32.658169 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l5jjx" Jul 29 17:35:34.682642 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:34.682586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:34.685174 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:34.685147 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f43b1001-8435-4d80-b26e-40a485fc9aba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tc7tr\" (UID: \"f43b1001-8435-4d80-b26e-40a485fc9aba\") " pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:34.795931 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:34.795904 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5kx8\"" Jul 29 17:35:34.804198 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:34.804169 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tc7tr" Jul 29 17:35:34.938008 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:34.937931 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tc7tr"] Jul 29 17:35:34.940880 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:34.940844 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43b1001_8435_4d80_b26e_40a485fc9aba.slice/crio-d85cc83c23393139bd744358a1af95c92101ab041d5eca89cb3221e3b235b4d5 WatchSource:0}: Error finding container d85cc83c23393139bd744358a1af95c92101ab041d5eca89cb3221e3b235b4d5: Status 404 returned error can't find the container with id d85cc83c23393139bd744358a1af95c92101ab041d5eca89cb3221e3b235b4d5 Jul 29 17:35:35.819412 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:35.819370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tc7tr" event={"ID":"f43b1001-8435-4d80-b26e-40a485fc9aba","Type":"ContainerStarted","Data":"d85cc83c23393139bd744358a1af95c92101ab041d5eca89cb3221e3b235b4d5"} Jul 29 17:35:38.117153 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.117108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:35:38.117713 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.117186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:35:38.119645 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.119615 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 17:35:38.120286 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.120258 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 17:35:38.130616 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.130589 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a0b10b1-1e60-438e-9ef5-cd3aff57a27b-original-pull-secret\") pod \"global-pull-secret-syncer-nk54l\" (UID: \"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b\") " pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:35:38.130760 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.130624 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/638db2e6-2136-4236-b37b-49b391776c7f-metrics-certs\") pod \"network-metrics-daemon-2rvxq\" (UID: \"638db2e6-2136-4236-b37b-49b391776c7f\") " pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:35:38.218111 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.218071 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:38.221158 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.221123 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7tkh\" (UniqueName: \"kubernetes.io/projected/9f1bbcc4-7f4e-43b1-b81a-515e94ec2543-kube-api-access-w7tkh\") pod \"network-check-target-hxnr6\" (UID: \"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543\") " pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:38.403183 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.403103 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tsgst\"" Jul 29 17:35:38.408713 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.408686 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mkqbv\"" Jul 29 17:35:38.411378 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.411353 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rvxq" Jul 29 17:35:38.413630 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.413607 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nk54l" Jul 29 17:35:38.417824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:38.417802 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:39.227447 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.227399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:39.227935 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.227498 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:39.227935 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.227531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:39.227935 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.227586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:39.228135 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.228030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:39.228240 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.228219 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52abb246-977c-4552-95f8-fe687432925f-service-ca-bundle\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:39.230682 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.230652 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d15c82c-3596-4a6d-9ad6-20615762b9c8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-lmqx8\" (UID: \"3d15c82c-3596-4a6d-9ad6-20615762b9c8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:39.230682 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.230678 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2lx\" (UID: \"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:39.230847 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.230831 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52abb246-977c-4552-95f8-fe687432925f-metrics-certs\") pod \"router-default-76556c6d69-rs85g\" (UID: \"52abb246-977c-4552-95f8-fe687432925f\") " pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:39.231757 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.231734 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"image-registry-69c4dc875c-gkbrj\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:39.328879 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.328840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:39.331494 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.331462 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ac0fe1-acb0-4d20-947f-628ee312524b-metrics-tls\") pod \"dns-default-lsh69\" (UID: \"e5ac0fe1-acb0-4d20-947f-628ee312524b\") " pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:39.426388 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.426355 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgjgr\"" Jul 29 17:35:39.434425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.434397 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:39.435433 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.435415 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m5sp6\"" Jul 29 17:35:39.444073 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.444054 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" Jul 29 17:35:39.458925 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.458901 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zzxbp\"" Jul 29 17:35:39.466554 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.466534 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:39.469711 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.469693 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nmscs\"" Jul 29 17:35:39.478397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.478340 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" Jul 29 17:35:39.523174 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.523155 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctlvv\"" Jul 29 17:35:39.531136 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:39.531115 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:40.166903 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.164739 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxnr6"] Jul 29 17:35:40.210171 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.210143 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx"] Jul 29 17:35:40.227338 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.227286 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69c4dc875c-gkbrj"] Jul 29 17:35:40.230682 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.230558 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76556c6d69-rs85g"] Jul 29 17:35:40.255491 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.255462 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2rvxq"] Jul 29 17:35:40.292249 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:40.292207 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1bbcc4_7f4e_43b1_b81a_515e94ec2543.slice/crio-09302a0ec16550ab52d781c194ebea5f61b67a9382d1e006c81eabc56df2891b WatchSource:0}: Error finding container 09302a0ec16550ab52d781c194ebea5f61b67a9382d1e006c81eabc56df2891b: Status 404 returned error can't find the container with id 09302a0ec16550ab52d781c194ebea5f61b67a9382d1e006c81eabc56df2891b Jul 29 17:35:40.292894 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:40.292859 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba9b7c3_2e7a_4bbd_ac1d_a1e490212f12.slice/crio-ddf8e692b45b6ba99f17b0fea6fa81d8daf667dda4c3187f6cd68bf340ef5df5 WatchSource:0}: Error finding container ddf8e692b45b6ba99f17b0fea6fa81d8daf667dda4c3187f6cd68bf340ef5df5: Status 404 returned error can't find the container with id ddf8e692b45b6ba99f17b0fea6fa81d8daf667dda4c3187f6cd68bf340ef5df5 Jul 29 17:35:40.294568 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:40.293685 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff2fcf1_a699_426a_aa08_1a7cff8aaf5e.slice/crio-dd23c4e025fcb2f5ceb99cd82eab30c40db5cdb6ea94d069b0d81a176724a534 WatchSource:0}: Error finding container dd23c4e025fcb2f5ceb99cd82eab30c40db5cdb6ea94d069b0d81a176724a534: Status 404 returned error can't find the container with id dd23c4e025fcb2f5ceb99cd82eab30c40db5cdb6ea94d069b0d81a176724a534 Jul 29 17:35:40.294916 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:40.294722 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52abb246_977c_4552_95f8_fe687432925f.slice/crio-191ff725fa4ac654de33c3d3ac40eeaa845156491a564973696421844a3cd1e1 WatchSource:0}: Error finding container 191ff725fa4ac654de33c3d3ac40eeaa845156491a564973696421844a3cd1e1: Status 404 returned error can't find the container with id 191ff725fa4ac654de33c3d3ac40eeaa845156491a564973696421844a3cd1e1 Jul 29 17:35:40.295290 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:40.295195 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638db2e6_2136_4236_b37b_49b391776c7f.slice/crio-db0fcac38ffa64548fcde08696de3ca3d2c8e800363dcf2d14dff4f5aeb05137 WatchSource:0}: Error finding container db0fcac38ffa64548fcde08696de3ca3d2c8e800363dcf2d14dff4f5aeb05137: Status 404 returned error can't find the container with id db0fcac38ffa64548fcde08696de3ca3d2c8e800363dcf2d14dff4f5aeb05137 Jul 29 17:35:40.481061 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.481018 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nk54l"] Jul 29 17:35:40.483265 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.483234 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8"] Jul 29 17:35:40.484016 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:40.483974 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0b10b1_1e60_438e_9ef5_cd3aff57a27b.slice/crio-97198cad83b23cfe09a42db3f5dc3079de03e972b08dbc8cc42052db4e850cf3 WatchSource:0}: Error finding container 97198cad83b23cfe09a42db3f5dc3079de03e972b08dbc8cc42052db4e850cf3: Status 404 returned error can't find the container with id 97198cad83b23cfe09a42db3f5dc3079de03e972b08dbc8cc42052db4e850cf3 Jul 29 17:35:40.490549 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.490420 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lsh69"] Jul 29 17:35:40.491334 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:35:40.491143 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ac0fe1_acb0_4d20_947f_628ee312524b.slice/crio-79adac339cb97b450b6a4d9ed1e226421cf99edb98763072cac92e8f1999cb8e WatchSource:0}: Error finding container 79adac339cb97b450b6a4d9ed1e226421cf99edb98763072cac92e8f1999cb8e: Status 404 returned error can't find the container with id 79adac339cb97b450b6a4d9ed1e226421cf99edb98763072cac92e8f1999cb8e Jul 29 17:35:40.837138 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.837094 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" event={"ID":"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12","Type":"ContainerStarted","Data":"ddf8e692b45b6ba99f17b0fea6fa81d8daf667dda4c3187f6cd68bf340ef5df5"} Jul 29 17:35:40.838587 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.838556 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2rvxq" event={"ID":"638db2e6-2136-4236-b37b-49b391776c7f","Type":"ContainerStarted","Data":"db0fcac38ffa64548fcde08696de3ca3d2c8e800363dcf2d14dff4f5aeb05137"} Jul 29 17:35:40.839867 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.839828 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" event={"ID":"3d15c82c-3596-4a6d-9ad6-20615762b9c8","Type":"ContainerStarted","Data":"e627c1dcd095e1344b71fafeb753e28ad2c22b013d08ba2ab086de5d2d3aa88f"} Jul 29 17:35:40.841353 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.841297 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nk54l" event={"ID":"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b","Type":"ContainerStarted","Data":"97198cad83b23cfe09a42db3f5dc3079de03e972b08dbc8cc42052db4e850cf3"} Jul 29 17:35:40.843578 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.843550 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxnr6" event={"ID":"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543","Type":"ContainerStarted","Data":"45ff5cca82c1be5b507b10473d27e9a46eff955424de91dca1819f04a6a4713a"} Jul 29 17:35:40.843702 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.843601 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxnr6" event={"ID":"9f1bbcc4-7f4e-43b1-b81a-515e94ec2543","Type":"ContainerStarted","Data":"09302a0ec16550ab52d781c194ebea5f61b67a9382d1e006c81eabc56df2891b"} Jul 29 17:35:40.843702 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.843650 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:35:40.845140 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.845110 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" event={"ID":"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e","Type":"ContainerStarted","Data":"ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999"} Jul 29 17:35:40.845254 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.845161 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" event={"ID":"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e","Type":"ContainerStarted","Data":"dd23c4e025fcb2f5ceb99cd82eab30c40db5cdb6ea94d069b0d81a176724a534"} Jul 29 17:35:40.845254 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.845212 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:35:40.846778 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.846752 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tc7tr" event={"ID":"f43b1001-8435-4d80-b26e-40a485fc9aba","Type":"ContainerStarted","Data":"4532a55b9011267e8988893295d12942cd0cad12726a8c4a24cf50f566e2862f"} Jul 29 17:35:40.848298 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.848278 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76556c6d69-rs85g" event={"ID":"52abb246-977c-4552-95f8-fe687432925f","Type":"ContainerStarted","Data":"423e8fc4f2a725a2e39abc6b34ef24148fa8ec97d211c9381710e48e299e3b69"} Jul 29 17:35:40.848444 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.848342 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76556c6d69-rs85g" event={"ID":"52abb246-977c-4552-95f8-fe687432925f","Type":"ContainerStarted","Data":"191ff725fa4ac654de33c3d3ac40eeaa845156491a564973696421844a3cd1e1"} Jul 29 17:35:40.849541 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.849509 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsh69" event={"ID":"e5ac0fe1-acb0-4d20-947f-628ee312524b","Type":"ContainerStarted","Data":"79adac339cb97b450b6a4d9ed1e226421cf99edb98763072cac92e8f1999cb8e"} Jul 29 17:35:40.859201 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.859150 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hxnr6" podStartSLOduration=68.859135356 podStartE2EDuration="1m8.859135356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:40.858397703 +0000 UTC m=+68.899283013" watchObservedRunningTime="2026-07-29 17:35:40.859135356 +0000 UTC m=+68.900020645" Jul 29 17:35:40.878373 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.878293 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" podStartSLOduration=67.878276457 podStartE2EDuration="1m7.878276457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:40.877494252 +0000 UTC m=+68.918379553" watchObservedRunningTime="2026-07-29 17:35:40.878276457 +0000 UTC m=+68.919161748" Jul 29 17:35:40.899249 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:40.899186 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76556c6d69-rs85g" podStartSLOduration=42.899163567 podStartE2EDuration="42.899163567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:40.898095988 +0000 UTC m=+68.938981313" watchObservedRunningTime="2026-07-29 17:35:40.899163567 +0000 UTC m=+68.940048858" Jul 29 17:35:41.467501 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.467377 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:41.470731 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.470701 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:41.698389 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.698333 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr"] Jul 29 17:35:41.700646 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.700621 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" Jul 29 17:35:41.703738 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.703711 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sqqx4\"" Jul 29 17:35:41.703994 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.703975 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 17:35:41.704294 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.704279 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 17:35:41.724922 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.724801 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr"] Jul 29 17:35:41.751685 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.751647 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc9af1a1-8db1-4cbe-bb56-5ad5a814882b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-5x4vr\" (UID: \"fc9af1a1-8db1-4cbe-bb56-5ad5a814882b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" Jul 29 17:35:41.752006 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.751714 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9af1a1-8db1-4cbe-bb56-5ad5a814882b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5x4vr\" (UID: \"fc9af1a1-8db1-4cbe-bb56-5ad5a814882b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" Jul 29 17:35:41.853072 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.853033 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc9af1a1-8db1-4cbe-bb56-5ad5a814882b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-5x4vr\" (UID: \"fc9af1a1-8db1-4cbe-bb56-5ad5a814882b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" Jul 29 17:35:41.853243 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.853102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9af1a1-8db1-4cbe-bb56-5ad5a814882b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5x4vr\" (UID: \"fc9af1a1-8db1-4cbe-bb56-5ad5a814882b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" Jul 29 17:35:41.854180 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.854117 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc9af1a1-8db1-4cbe-bb56-5ad5a814882b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-5x4vr\" (UID: \"fc9af1a1-8db1-4cbe-bb56-5ad5a814882b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" Jul 29 17:35:41.860176 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.858915 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9af1a1-8db1-4cbe-bb56-5ad5a814882b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-5x4vr\" (UID: \"fc9af1a1-8db1-4cbe-bb56-5ad5a814882b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" Jul 29 17:35:41.864236 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.863423 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:41.865358 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:41.865033 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76556c6d69-rs85g" Jul 29 17:35:42.018374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:42.018286 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" Jul 29 17:35:42.241646 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:42.237654 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr"] Jul 29 17:35:42.487878 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:42.487470 2560 scope.go:117] "RemoveContainer" containerID="2a22ee740e9a783987dd75023602b7893e4a0227d9c76e9be627e90876da9a14" Jul 29 17:35:42.869629 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:42.869585 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" event={"ID":"fc9af1a1-8db1-4cbe-bb56-5ad5a814882b","Type":"ContainerStarted","Data":"fdef73ee50f39011468aa3519a0283265e3fd2fe71cb1cfb7898a549c71daf72"} Jul 29 17:35:42.873996 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:42.873963 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2rvxq" event={"ID":"638db2e6-2136-4236-b37b-49b391776c7f","Type":"ContainerStarted","Data":"07f725c0111cc245694583bbcb3f12ee09e066a69e8cc9b08e1e33e42abade9c"} Jul 29 17:35:42.874149 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:42.874021 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2rvxq" event={"ID":"638db2e6-2136-4236-b37b-49b391776c7f","Type":"ContainerStarted","Data":"a02835d9618f18c409bc2ed6975b5a0c867358f9f956744d5eaa305b1a257e09"} Jul 29 17:35:42.890783 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:42.890717 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2rvxq" podStartSLOduration=69.348600084 podStartE2EDuration="1m10.890694827s" totalImagesPullingTime="1.542094743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:42.889189211 +0000 UTC m=+70.930074504" watchObservedRunningTime="2026-07-29 17:35:42.890694827 +0000 UTC m=+70.931580118" Jul 29 17:35:49.903375 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.903333 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tc7tr" event={"ID":"f43b1001-8435-4d80-b26e-40a485fc9aba","Type":"ContainerStarted","Data":"cdf0205acd9e4629ad6d85c1eadf951a28458883cbd4ea4747b75aad5402c087"} Jul 29 17:35:49.904954 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.904927 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" event={"ID":"3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12","Type":"ContainerStarted","Data":"0cf210a0caa09f01e2f2ee3b582ed665c0575e8b5a1e4495b47910a409326bee"} Jul 29 17:35:49.906802 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.906743 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" event={"ID":"fc9af1a1-8db1-4cbe-bb56-5ad5a814882b","Type":"ContainerStarted","Data":"858e83a7d5f3263494c3cd8bceda5b2a51655689dbfad8df7456eea9cf67fb04"} Jul 29 17:35:49.908764 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.908748 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/1.log" Jul 29 17:35:49.908887 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.908870 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" event={"ID":"9c1e1a5b-4263-4e71-9691-6148749e0e67","Type":"ContainerStarted","Data":"da6b4d834c69e88b0209371590900021681b17ceaabca5b1250b605b1877e81e"} Jul 29 17:35:49.909137 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.909119 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:49.910622 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.910595 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsh69" event={"ID":"e5ac0fe1-acb0-4d20-947f-628ee312524b","Type":"ContainerStarted","Data":"af961c242adcfd5012d11cbc312b638eb68c004a096a79121bd64f90051f1e8f"} Jul 29 17:35:49.910712 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.910630 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsh69" event={"ID":"e5ac0fe1-acb0-4d20-947f-628ee312524b","Type":"ContainerStarted","Data":"7bae5698bb2cb89274d18a538f55bd5b55dbbaa17ac7eb090bbe86f911531c61"} Jul 29 17:35:49.910862 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.910850 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lsh69" Jul 29 17:35:49.912580 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.912554 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" event={"ID":"3d15c82c-3596-4a6d-9ad6-20615762b9c8","Type":"ContainerStarted","Data":"645b66bcf75886269161e1c01b71b4ea403369c7873aa8729ba0ef88f55687b9"} Jul 29 17:35:49.912690 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.912592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" event={"ID":"3d15c82c-3596-4a6d-9ad6-20615762b9c8","Type":"ContainerStarted","Data":"ad869aa616303129f8d2a07528411669b84d9f733f8ea8f4ba0d2c4f8fca7ea2"} Jul 29 17:35:49.914211 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.914193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nk54l" event={"ID":"9a0b10b1-1e60-438e-9ef5-cd3aff57a27b","Type":"ContainerStarted","Data":"fdf5e351a18b02745daa78b18762c0dacdf30a496a44eeffec795a54b0570b4d"} Jul 29 17:35:49.920365 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.920326 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2lx" podStartSLOduration=43.728196282 podStartE2EDuration="51.920294141s" totalImagesPullingTime="8.192097859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:49.919906337 +0000 UTC m=+77.960791650" watchObservedRunningTime="2026-07-29 17:35:49.920294141 +0000 UTC m=+77.961179431" Jul 29 17:35:49.935911 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.935863 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-lmqx8" podStartSLOduration=44.149265282 podStartE2EDuration="51.935848975s" totalImagesPullingTime="7.786583693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:49.935084891 +0000 UTC m=+77.975970235" watchObservedRunningTime="2026-07-29 17:35:49.935848975 +0000 UTC m=+77.976734265" Jul 29 17:35:49.955091 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.955033 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nk54l" podStartSLOduration=69.493921402 podStartE2EDuration="1m17.955016165s" totalImagesPullingTime="8.461094763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:49.954239922 +0000 UTC m=+77.995125237" watchObservedRunningTime="2026-07-29 17:35:49.955016165 +0000 UTC m=+77.995901455" Jul 29 17:35:49.975435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:49.975380 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" podStartSLOduration=43.921981774 podStartE2EDuration="51.975364726s" totalImagesPullingTime="8.053382952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:49.975085827 +0000 UTC m=+78.015971118" watchObservedRunningTime="2026-07-29 17:35:49.975364726 +0000 UTC m=+78.016250016" Jul 29 17:35:50.002012 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:50.001952 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-5x4vr" podStartSLOduration=2.298063559 podStartE2EDuration="9.001932201s" totalImagesPullingTime="6.703868642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:49.998870227 +0000 UTC m=+78.039755543" watchObservedRunningTime="2026-07-29 17:35:50.001932201 +0000 UTC m=+78.042817495" Jul 29 17:35:50.037699 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:50.037536 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lsh69" podStartSLOduration=35.017474195 podStartE2EDuration="43.037514311s" totalImagesPullingTime="8.020040116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:50.035569922 +0000 UTC m=+78.076455260" watchObservedRunningTime="2026-07-29 17:35:50.037514311 +0000 UTC m=+78.078399606" Jul 29 17:35:50.042556 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:50.042494 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-nzz85" Jul 29 17:35:53.934706 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:53.934616 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tc7tr" event={"ID":"f43b1001-8435-4d80-b26e-40a485fc9aba","Type":"ContainerStarted","Data":"510f4807747ca56eeef699031eb9d8f4ba665cd09ca6a3c7e954b95a62b76367"} Jul 29 17:35:53.955332 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:53.955258 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tc7tr" podStartSLOduration=17.663063823999998 podStartE2EDuration="35.955241375s" totalImagesPullingTime="18.292177551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:35:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:35:53.953546993 +0000 UTC m=+81.994432302" watchObservedRunningTime="2026-07-29 17:35:53.955241375 +0000 UTC m=+81.996126665" Jul 29 17:35:59.922942 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:35:59.922902 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lsh69" Jul 29 17:36:01.868317 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:01.868272 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:36:04.256685 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:04.256649 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69c4dc875c-gkbrj"] Jul 29 17:36:06.018691 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.018653 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vpk27"] Jul 29 17:36:06.021745 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.021724 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.024611 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.024584 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 17:36:06.024908 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.024892 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 17:36:06.025387 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.025370 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 17:36:06.025476 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.025390 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t4z2s\"" Jul 29 17:36:06.025552 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.025394 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 17:36:06.058944 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.058910 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-tls\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.059122 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.058954 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-wtmp\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.059122 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.058982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.059122 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.059044 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d6a947a-a0a3-4595-b3aa-d62b62485872-sys\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.059122 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.059091 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.059298 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.059130 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d6a947a-a0a3-4595-b3aa-d62b62485872-metrics-client-ca\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.059298 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.059152 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwkvk\" (UniqueName: \"kubernetes.io/projected/3d6a947a-a0a3-4595-b3aa-d62b62485872-kube-api-access-wwkvk\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.059298 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.059169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d6a947a-a0a3-4595-b3aa-d62b62485872-root\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.059298 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.059189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-textfile\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.159667 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d6a947a-a0a3-4595-b3aa-d62b62485872-root\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.159848 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159676 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-textfile\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.159848 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-tls\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.159848 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159746 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d6a947a-a0a3-4595-b3aa-d62b62485872-root\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.159848 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159758 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-wtmp\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.159848 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.159848 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d6a947a-a0a3-4595-b3aa-d62b62485872-sys\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.160139 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.160139 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d6a947a-a0a3-4595-b3aa-d62b62485872-metrics-client-ca\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.160139 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159935 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-wtmp\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.160139 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159953 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d6a947a-a0a3-4595-b3aa-d62b62485872-sys\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.160139 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.159944 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwkvk\" (UniqueName: \"kubernetes.io/projected/3d6a947a-a0a3-4595-b3aa-d62b62485872-kube-api-access-wwkvk\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.160139 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.160120 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-textfile\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.160576 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.160555 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.160643 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.160572 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d6a947a-a0a3-4595-b3aa-d62b62485872-metrics-client-ca\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.162568 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.162534 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.162666 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.162573 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d6a947a-a0a3-4595-b3aa-d62b62485872-node-exporter-tls\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.167909 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.167884 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwkvk\" (UniqueName: \"kubernetes.io/projected/3d6a947a-a0a3-4595-b3aa-d62b62485872-kube-api-access-wwkvk\") pod \"node-exporter-vpk27\" (UID: \"3d6a947a-a0a3-4595-b3aa-d62b62485872\") " pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.331059 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.330978 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vpk27" Jul 29 17:36:06.343947 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:36:06.343909 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6a947a_a0a3_4595_b3aa_d62b62485872.slice/crio-fe7aecba376f90450e8e144e9a6cab777dd9b7049fbc9886727bcb76eee9bed6 WatchSource:0}: Error finding container fe7aecba376f90450e8e144e9a6cab777dd9b7049fbc9886727bcb76eee9bed6: Status 404 returned error can't find the container with id fe7aecba376f90450e8e144e9a6cab777dd9b7049fbc9886727bcb76eee9bed6 Jul 29 17:36:06.984935 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:06.984894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpk27" event={"ID":"3d6a947a-a0a3-4595-b3aa-d62b62485872","Type":"ContainerStarted","Data":"fe7aecba376f90450e8e144e9a6cab777dd9b7049fbc9886727bcb76eee9bed6"} Jul 29 17:36:07.990582 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:07.990544 2560 generic.go:356] "Generic (PLEG): container finished" podID="3d6a947a-a0a3-4595-b3aa-d62b62485872" containerID="143d74f42998b68e03e8a57f112fbc0198abefcacd1944cd352d3e13ff8b475f" exitCode=0 Jul 29 17:36:07.991072 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:07.990602 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpk27" event={"ID":"3d6a947a-a0a3-4595-b3aa-d62b62485872","Type":"ContainerDied","Data":"143d74f42998b68e03e8a57f112fbc0198abefcacd1944cd352d3e13ff8b475f"} Jul 29 17:36:08.997351 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:08.997291 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpk27" event={"ID":"3d6a947a-a0a3-4595-b3aa-d62b62485872","Type":"ContainerStarted","Data":"50c384c841aee5ec5ba6477ad8a74124572c609736ff2a555439c639062b3eb3"} Jul 29 17:36:08.997743 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:08.997380 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpk27" event={"ID":"3d6a947a-a0a3-4595-b3aa-d62b62485872","Type":"ContainerStarted","Data":"0c4e54cae49bb7e91817e495b43b6c5a8d6c75194f2d73dec83bf9cea4861673"} Jul 29 17:36:09.017731 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:09.017675 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vpk27" podStartSLOduration=3.136528233 podStartE2EDuration="4.017657391s" totalImagesPullingTime="806.624835ms" totalInitContainerRuntime="74.504323ms" isStatefulPod=true podCreationTimestamp="2026-07-29 17:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:09.017441856 +0000 UTC m=+97.058327171" watchObservedRunningTime="2026-07-29 17:36:09.017657391 +0000 UTC m=+97.058542943" Jul 29 17:36:11.865794 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:11.865700 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hxnr6" Jul 29 17:36:16.573395 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.573360 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c4c4fb7dc-kkp4q"] Jul 29 17:36:16.589820 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.589778 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4c4fb7dc-kkp4q"] Jul 29 17:36:16.590004 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.589907 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.592074 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.592047 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 17:36:16.592230 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.592172 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 17:36:16.592319 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.592255 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 17:36:16.592850 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.592830 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kxlww\"" Jul 29 17:36:16.592967 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.592903 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 17:36:16.592967 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.592909 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 17:36:16.593120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.592913 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 17:36:16.593120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.593035 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 17:36:16.596718 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.596698 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 17:36:16.626033 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.625987 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-oauth-config\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.626033 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.626034 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-config\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.626274 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.626066 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f9j4\" (UniqueName: \"kubernetes.io/projected/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-kube-api-access-4f9j4\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.626274 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.626096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-serving-cert\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.626274 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.626118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-trusted-ca-bundle\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.626274 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.626143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-oauth-serving-cert\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.626457 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.626272 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-service-ca\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.727435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.727400 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-service-ca\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.727435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.727442 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-oauth-config\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.727704 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.727568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-config\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.727704 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.727619 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f9j4\" (UniqueName: \"kubernetes.io/projected/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-kube-api-access-4f9j4\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.727704 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.727653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-serving-cert\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.727704 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.727678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-trusted-ca-bundle\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.727892 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.727709 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-oauth-serving-cert\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.728497 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.728428 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-service-ca\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.728625 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.728471 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-config\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.728625 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.728480 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-oauth-serving-cert\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.728767 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.728744 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-trusted-ca-bundle\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.729947 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.729927 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-oauth-config\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.730149 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.730132 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-serving-cert\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.735037 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.735019 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f9j4\" (UniqueName: \"kubernetes.io/projected/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-kube-api-access-4f9j4\") pod \"console-c4c4fb7dc-kkp4q\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:16.902643 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:16.902543 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:17.047263 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:17.047235 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4c4fb7dc-kkp4q"] Jul 29 17:36:17.049980 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:36:17.049950 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d2c8d6_28c5_4bd5_ae19_0b892872c00f.slice/crio-549a49cb99f7ea7d15879a6ca700548128c8e4f0e7a519793e51b6f603a0b61d WatchSource:0}: Error finding container 549a49cb99f7ea7d15879a6ca700548128c8e4f0e7a519793e51b6f603a0b61d: Status 404 returned error can't find the container with id 549a49cb99f7ea7d15879a6ca700548128c8e4f0e7a519793e51b6f603a0b61d Jul 29 17:36:18.036703 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:18.036654 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4c4fb7dc-kkp4q" event={"ID":"03d2c8d6-28c5-4bd5-ae19-0b892872c00f","Type":"ContainerStarted","Data":"549a49cb99f7ea7d15879a6ca700548128c8e4f0e7a519793e51b6f603a0b61d"} Jul 29 17:36:21.050564 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:21.050529 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4c4fb7dc-kkp4q" event={"ID":"03d2c8d6-28c5-4bd5-ae19-0b892872c00f","Type":"ContainerStarted","Data":"7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408"} Jul 29 17:36:21.068920 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:21.068850 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c4c4fb7dc-kkp4q" podStartSLOduration=1.484520086 podStartE2EDuration="5.068828392s" totalImagesPullingTime="3.584308306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:21.068105598 +0000 UTC m=+109.108990908" watchObservedRunningTime="2026-07-29 17:36:21.068828392 +0000 UTC m=+109.109713684" Jul 29 17:36:24.249417 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.249383 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4c4fb7dc-kkp4q"] Jul 29 17:36:24.288661 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.288625 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd49d457-dsxcp"] Jul 29 17:36:24.318884 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.318842 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd49d457-dsxcp"] Jul 29 17:36:24.319075 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.318987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.395249 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.395213 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sll4\" (UniqueName: \"kubernetes.io/projected/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-kube-api-access-8sll4\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.395249 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.395260 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-trusted-ca-bundle\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.395503 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.395287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-oauth-config\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.395503 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.395352 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-service-ca\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.395503 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.395404 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-serving-cert\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.395503 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.395435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-config\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.395637 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.395529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-oauth-serving-cert\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.495961 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.495925 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-serving-cert\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.496163 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.495970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-config\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.496163 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.496028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-oauth-serving-cert\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.496163 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.496065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sll4\" (UniqueName: \"kubernetes.io/projected/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-kube-api-access-8sll4\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.496163 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.496103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-trusted-ca-bundle\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.496425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.496169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-oauth-config\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.496425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.496192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-service-ca\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.496856 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.496817 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-oauth-serving-cert\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.497015 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.496985 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-config\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.497203 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.497180 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-service-ca\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.497276 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.497223 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-trusted-ca-bundle\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.498761 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.498730 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-serving-cert\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.498911 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.498894 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-oauth-config\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.504058 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.503993 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sll4\" (UniqueName: \"kubernetes.io/projected/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-kube-api-access-8sll4\") pod \"console-cd49d457-dsxcp\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.630755 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.630710 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:24.801020 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:24.800997 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd49d457-dsxcp"] Jul 29 17:36:24.803482 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:36:24.803452 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b4e6dd_b5da_4b89_9edc_b83ec005fcc2.slice/crio-1d31b71cdb1ce36af0db4feda3c4fb18958bd01d9ac87c91af708331590049b1 WatchSource:0}: Error finding container 1d31b71cdb1ce36af0db4feda3c4fb18958bd01d9ac87c91af708331590049b1: Status 404 returned error can't find the container with id 1d31b71cdb1ce36af0db4feda3c4fb18958bd01d9ac87c91af708331590049b1 Jul 29 17:36:25.067907 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:25.067806 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd49d457-dsxcp" event={"ID":"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2","Type":"ContainerStarted","Data":"ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490"} Jul 29 17:36:25.067907 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:25.067859 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd49d457-dsxcp" event={"ID":"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2","Type":"ContainerStarted","Data":"1d31b71cdb1ce36af0db4feda3c4fb18958bd01d9ac87c91af708331590049b1"} Jul 29 17:36:25.086573 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:25.086517 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cd49d457-dsxcp" podStartSLOduration=1.086498691 podStartE2EDuration="1.086498691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:36:25.085762801 +0000 UTC m=+113.126648127" watchObservedRunningTime="2026-07-29 17:36:25.086498691 +0000 UTC m=+113.127383980" Jul 29 17:36:26.903246 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:26.903202 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:28.081635 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:28.081598 2560 generic.go:356] "Generic (PLEG): container finished" podID="e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd" containerID="cd8de46e197882ae8999bfc007ce8495e30a6b2a7699ee0114c6cf48d2a91247" exitCode=0 Jul 29 17:36:28.082023 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:28.081655 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" event={"ID":"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd","Type":"ContainerDied","Data":"cd8de46e197882ae8999bfc007ce8495e30a6b2a7699ee0114c6cf48d2a91247"} Jul 29 17:36:28.082023 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:28.081987 2560 scope.go:117] "RemoveContainer" containerID="cd8de46e197882ae8999bfc007ce8495e30a6b2a7699ee0114c6cf48d2a91247" Jul 29 17:36:29.087670 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.087636 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-gnkv2" event={"ID":"e17a1e08-4d9c-45a6-b015-7c32a6dc1dfd","Type":"ContainerStarted","Data":"1c75022fa17f98c2d54751a2ea5a4afc1a8241813a559d60902a28c63bbe1f00"} Jul 29 17:36:29.276612 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.276568 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" podUID="2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" containerName="registry" containerID="cri-o://ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999" gracePeriod=30 Jul 29 17:36:29.529749 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.529724 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:36:29.639089 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.638999 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-installation-pull-secrets\") pod \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " Jul 29 17:36:29.639089 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.639065 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-bound-sa-token\") pod \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " Jul 29 17:36:29.639340 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.639110 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-certificates\") pod \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " Jul 29 17:36:29.639340 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.639135 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-ca-trust-extracted\") pod \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " Jul 29 17:36:29.639340 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.639161 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") pod \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " Jul 29 17:36:29.639340 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.639196 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-image-registry-private-configuration\") pod \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " Jul 29 17:36:29.639340 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.639226 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zxtl\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-kube-api-access-8zxtl\") pod \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " Jul 29 17:36:29.639340 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.639260 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-trusted-ca\") pod \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\" (UID: \"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e\") " Jul 29 17:36:29.639642 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.639565 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:29.639875 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.639842 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:29.642622 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.642598 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:36:29.642622 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.642606 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:36:29.642801 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.642703 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-kube-api-access-8zxtl" (OuterVolumeSpecName: "kube-api-access-8zxtl") pod "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e"). InnerVolumeSpecName "kube-api-access-8zxtl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:36:29.642801 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.642709 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:36:29.642801 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.642732 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:36:29.648171 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.648139 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" (UID: "2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:36:29.740805 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.740768 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-installation-pull-secrets\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:29.740805 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.740797 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-bound-sa-token\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:29.740805 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.740808 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-certificates\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:29.740805 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.740817 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-ca-trust-extracted\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:29.741073 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.740826 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-registry-tls\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:29.741073 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.740835 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-image-registry-private-configuration\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:29.741073 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.740844 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zxtl\" (UniqueName: \"kubernetes.io/projected/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-kube-api-access-8zxtl\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:29.741073 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:29.740853 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e-trusted-ca\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:30.092108 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.092068 2560 generic.go:356] "Generic (PLEG): container finished" podID="2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" containerID="ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999" exitCode=0 Jul 29 17:36:30.092563 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.092121 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" Jul 29 17:36:30.092563 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.092126 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" event={"ID":"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e","Type":"ContainerDied","Data":"ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999"} Jul 29 17:36:30.092563 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.092177 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69c4dc875c-gkbrj" event={"ID":"2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e","Type":"ContainerDied","Data":"dd23c4e025fcb2f5ceb99cd82eab30c40db5cdb6ea94d069b0d81a176724a534"} Jul 29 17:36:30.092563 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.092204 2560 scope.go:117] "RemoveContainer" containerID="ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999" Jul 29 17:36:30.101429 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.101408 2560 scope.go:117] "RemoveContainer" containerID="ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999" Jul 29 17:36:30.101738 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:36:30.101719 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999\": container with ID starting with ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999 not found: ID does not exist" containerID="ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999" Jul 29 17:36:30.101779 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.101748 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999"} err="failed to get container status \"ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999\": rpc error: code = NotFound desc = could not find container \"ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999\": container with ID starting with ce180bbac6969fe90abbcfddd3842cc25d14c03086da0b48428bc590cbc6e999 not found: ID does not exist" Jul 29 17:36:30.112332 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.112284 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69c4dc875c-gkbrj"] Jul 29 17:36:30.115814 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.115791 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69c4dc875c-gkbrj"] Jul 29 17:36:30.489074 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:30.488991 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" path="/var/lib/kubelet/pods/2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e/volumes" Jul 29 17:36:33.104836 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:33.104798 2560 generic.go:356] "Generic (PLEG): container finished" podID="9e12b11b-e9f5-4b73-91e7-2f8f1b581579" containerID="48ff4edeabf15e80ea9028ceb21041c39b3242d551b25775aff5cc9cb211d882" exitCode=0 Jul 29 17:36:33.105341 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:33.104873 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" event={"ID":"9e12b11b-e9f5-4b73-91e7-2f8f1b581579","Type":"ContainerDied","Data":"48ff4edeabf15e80ea9028ceb21041c39b3242d551b25775aff5cc9cb211d882"} Jul 29 17:36:33.105341 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:33.105276 2560 scope.go:117] "RemoveContainer" containerID="48ff4edeabf15e80ea9028ceb21041c39b3242d551b25775aff5cc9cb211d882" Jul 29 17:36:34.111164 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:34.111127 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9" event={"ID":"9e12b11b-e9f5-4b73-91e7-2f8f1b581579","Type":"ContainerStarted","Data":"45e6d259e20abc32c4c7a7d70ddad626ef2cbbd338028dee43963010e5acc665"} Jul 29 17:36:34.631369 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:34.631329 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:34.631633 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:34.631391 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:34.636342 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:34.636315 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:35.118879 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:35.118838 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:36:43.144118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:43.144076 2560 generic.go:356] "Generic (PLEG): container finished" podID="2ee85931-a2e7-4ad3-ad32-b5b22184af25" containerID="9d986d7af23e468f538a5b0df7ee42455ed1fcc313b2b9bad5ab9e48cc41a40a" exitCode=0 Jul 29 17:36:43.144516 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:43.144144 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-j7295" event={"ID":"2ee85931-a2e7-4ad3-ad32-b5b22184af25","Type":"ContainerDied","Data":"9d986d7af23e468f538a5b0df7ee42455ed1fcc313b2b9bad5ab9e48cc41a40a"} Jul 29 17:36:43.144580 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:43.144564 2560 scope.go:117] "RemoveContainer" containerID="9d986d7af23e468f538a5b0df7ee42455ed1fcc313b2b9bad5ab9e48cc41a40a" Jul 29 17:36:44.150389 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:44.150353 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-j7295" event={"ID":"2ee85931-a2e7-4ad3-ad32-b5b22184af25","Type":"ContainerStarted","Data":"7f0abfc649383315a767488908d057a78b971c71042415346697320038a98517"} Jul 29 17:36:49.269756 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.269719 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c4c4fb7dc-kkp4q" podUID="03d2c8d6-28c5-4bd5-ae19-0b892872c00f" containerName="console" containerID="cri-o://7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408" gracePeriod=15 Jul 29 17:36:49.515715 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.515690 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:49.601617 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.601517 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-config\") pod \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " Jul 29 17:36:49.601617 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.601564 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-serving-cert\") pod \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " Jul 29 17:36:49.601617 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.601585 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-service-ca\") pod \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " Jul 29 17:36:49.601617 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.601614 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f9j4\" (UniqueName: \"kubernetes.io/projected/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-kube-api-access-4f9j4\") pod \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " Jul 29 17:36:49.601950 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.601651 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-trusted-ca-bundle\") pod \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " Jul 29 17:36:49.601950 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.601708 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-oauth-serving-cert\") pod \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " Jul 29 17:36:49.601950 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.601767 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-oauth-config\") pod \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\" (UID: \"03d2c8d6-28c5-4bd5-ae19-0b892872c00f\") " Jul 29 17:36:49.602093 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.602038 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-config" (OuterVolumeSpecName: "console-config") pod "03d2c8d6-28c5-4bd5-ae19-0b892872c00f" (UID: "03d2c8d6-28c5-4bd5-ae19-0b892872c00f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:49.602093 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.602080 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-service-ca" (OuterVolumeSpecName: "service-ca") pod "03d2c8d6-28c5-4bd5-ae19-0b892872c00f" (UID: "03d2c8d6-28c5-4bd5-ae19-0b892872c00f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:49.602209 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.602114 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03d2c8d6-28c5-4bd5-ae19-0b892872c00f" (UID: "03d2c8d6-28c5-4bd5-ae19-0b892872c00f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:49.602209 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.602156 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03d2c8d6-28c5-4bd5-ae19-0b892872c00f" (UID: "03d2c8d6-28c5-4bd5-ae19-0b892872c00f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:36:49.604124 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.604103 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03d2c8d6-28c5-4bd5-ae19-0b892872c00f" (UID: "03d2c8d6-28c5-4bd5-ae19-0b892872c00f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:36:49.604205 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.604155 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03d2c8d6-28c5-4bd5-ae19-0b892872c00f" (UID: "03d2c8d6-28c5-4bd5-ae19-0b892872c00f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:36:49.604316 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.604282 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-kube-api-access-4f9j4" (OuterVolumeSpecName: "kube-api-access-4f9j4") pod "03d2c8d6-28c5-4bd5-ae19-0b892872c00f" (UID: "03d2c8d6-28c5-4bd5-ae19-0b892872c00f"). InnerVolumeSpecName "kube-api-access-4f9j4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:36:49.702818 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.702782 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-oauth-config\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:49.702818 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.702813 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-config\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:49.702818 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.702824 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-console-serving-cert\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:49.703048 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.702832 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-service-ca\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:49.703048 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.702841 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f9j4\" (UniqueName: \"kubernetes.io/projected/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-kube-api-access-4f9j4\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:49.703048 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.702850 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-trusted-ca-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:49.703048 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:49.702858 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03d2c8d6-28c5-4bd5-ae19-0b892872c00f-oauth-serving-cert\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:36:50.173412 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.173364 2560 generic.go:356] "Generic (PLEG): container finished" podID="03d2c8d6-28c5-4bd5-ae19-0b892872c00f" containerID="7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408" exitCode=0 Jul 29 17:36:50.174018 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.173421 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4c4fb7dc-kkp4q" Jul 29 17:36:50.174018 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.173432 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4c4fb7dc-kkp4q" event={"ID":"03d2c8d6-28c5-4bd5-ae19-0b892872c00f","Type":"ContainerDied","Data":"7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408"} Jul 29 17:36:50.174018 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.173500 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4c4fb7dc-kkp4q" event={"ID":"03d2c8d6-28c5-4bd5-ae19-0b892872c00f","Type":"ContainerDied","Data":"549a49cb99f7ea7d15879a6ca700548128c8e4f0e7a519793e51b6f603a0b61d"} Jul 29 17:36:50.174018 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.173529 2560 scope.go:117] "RemoveContainer" containerID="7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408" Jul 29 17:36:50.184625 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.184600 2560 scope.go:117] "RemoveContainer" containerID="7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408" Jul 29 17:36:50.184999 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:36:50.184966 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408\": container with ID starting with 7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408 not found: ID does not exist" containerID="7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408" Jul 29 17:36:50.185106 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.185011 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408"} err="failed to get container status \"7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408\": rpc error: code = NotFound desc = could not find container \"7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408\": container with ID starting with 7acdd1fa3cf466cc2deaeb7c2cb522f086bc6620a5ea881a421f316ed3432408 not found: ID does not exist" Jul 29 17:36:50.195278 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.195254 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4c4fb7dc-kkp4q"] Jul 29 17:36:50.201316 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.201284 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c4c4fb7dc-kkp4q"] Jul 29 17:36:50.491069 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:36:50.491026 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03d2c8d6-28c5-4bd5-ae19-0b892872c00f" path="/var/lib/kubelet/pods/03d2c8d6-28c5-4bd5-ae19-0b892872c00f/volumes" Jul 29 17:37:38.628378 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.628336 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79fc7f45d8-c9wwn"] Jul 29 17:37:38.628784 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.628745 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d2c8d6-28c5-4bd5-ae19-0b892872c00f" containerName="console" Jul 29 17:37:38.628784 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.628762 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d2c8d6-28c5-4bd5-ae19-0b892872c00f" containerName="console" Jul 29 17:37:38.628784 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.628774 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" containerName="registry" Jul 29 17:37:38.628784 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.628780 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" containerName="registry" Jul 29 17:37:38.628906 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.628842 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="03d2c8d6-28c5-4bd5-ae19-0b892872c00f" containerName="console" Jul 29 17:37:38.628906 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.628850 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff2fcf1-a699-426a-aa08-1a7cff8aaf5e" containerName="registry" Jul 29 17:37:38.632697 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.632673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.646746 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.646717 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79fc7f45d8-c9wwn"] Jul 29 17:37:38.669160 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.669121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-console-config\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.669398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.669168 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-serving-cert\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.669398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.669195 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-oauth-serving-cert\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.669398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.669260 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-service-ca\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.669398 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.669297 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-trusted-ca-bundle\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.669586 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.669391 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmn9h\" (UniqueName: \"kubernetes.io/projected/ff3a8a78-9c1e-4728-8457-1015047b995e-kube-api-access-pmn9h\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.669586 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.669463 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-oauth-config\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.770734 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.770688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-console-config\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.770734 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.770741 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-serving-cert\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.771007 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.770771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-oauth-serving-cert\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.771007 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.770793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-service-ca\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.771007 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.770825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-trusted-ca-bundle\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.771007 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.770852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmn9h\" (UniqueName: \"kubernetes.io/projected/ff3a8a78-9c1e-4728-8457-1015047b995e-kube-api-access-pmn9h\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.771007 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.770899 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-oauth-config\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.771717 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.771613 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-console-config\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.771717 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.771647 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-oauth-serving-cert\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.771915 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.771804 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-service-ca\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.771915 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.771808 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-trusted-ca-bundle\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.773468 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.773447 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-oauth-config\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.773693 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.773671 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-serving-cert\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.778822 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.778799 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmn9h\" (UniqueName: \"kubernetes.io/projected/ff3a8a78-9c1e-4728-8457-1015047b995e-kube-api-access-pmn9h\") pod \"console-79fc7f45d8-c9wwn\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:38.942724 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:38.942622 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:39.090471 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:39.090438 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79fc7f45d8-c9wwn"] Jul 29 17:37:39.093092 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:37:39.093062 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3a8a78_9c1e_4728_8457_1015047b995e.slice/crio-999f5d53c9955f44a4bff0871065c1ba12b00798e65b7410cf50f5098dda1fa4 WatchSource:0}: Error finding container 999f5d53c9955f44a4bff0871065c1ba12b00798e65b7410cf50f5098dda1fa4: Status 404 returned error can't find the container with id 999f5d53c9955f44a4bff0871065c1ba12b00798e65b7410cf50f5098dda1fa4 Jul 29 17:37:39.364148 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:39.364114 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79fc7f45d8-c9wwn" event={"ID":"ff3a8a78-9c1e-4728-8457-1015047b995e","Type":"ContainerStarted","Data":"4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615"} Jul 29 17:37:39.364355 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:39.364162 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79fc7f45d8-c9wwn" event={"ID":"ff3a8a78-9c1e-4728-8457-1015047b995e","Type":"ContainerStarted","Data":"999f5d53c9955f44a4bff0871065c1ba12b00798e65b7410cf50f5098dda1fa4"} Jul 29 17:37:39.387095 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:39.386981 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79fc7f45d8-c9wwn" podStartSLOduration=1.386958114 podStartE2EDuration="1.386958114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:37:39.381021334 +0000 UTC m=+187.421906625" watchObservedRunningTime="2026-07-29 17:37:39.386958114 +0000 UTC m=+187.427843406" Jul 29 17:37:48.943418 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:48.943374 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:48.943902 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:48.943438 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:48.948459 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:48.948434 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:49.406511 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:49.406485 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:37:49.454657 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:37:49.454617 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd49d457-dsxcp"] Jul 29 17:38:14.476977 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.476918 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cd49d457-dsxcp" podUID="f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" containerName="console" containerID="cri-o://ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490" gracePeriod=15 Jul 29 17:38:14.722526 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.722500 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:38:14.875412 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.875377 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-oauth-config\") pod \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " Jul 29 17:38:14.875608 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.875450 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sll4\" (UniqueName: \"kubernetes.io/projected/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-kube-api-access-8sll4\") pod \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " Jul 29 17:38:14.875608 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.875482 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-oauth-serving-cert\") pod \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " Jul 29 17:38:14.875608 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.875498 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-service-ca\") pod \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " Jul 29 17:38:14.875608 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.875517 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-serving-cert\") pod \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " Jul 29 17:38:14.875608 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.875541 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-config\") pod \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " Jul 29 17:38:14.875608 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.875561 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-trusted-ca-bundle\") pod \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\" (UID: \"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2\") " Jul 29 17:38:14.875994 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.875958 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" (UID: "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:38:14.876118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.876079 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-service-ca" (OuterVolumeSpecName: "service-ca") pod "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" (UID: "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:38:14.876118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.876089 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-config" (OuterVolumeSpecName: "console-config") pod "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" (UID: "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:38:14.876218 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.876113 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" (UID: "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:38:14.877823 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.877802 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" (UID: "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:38:14.878191 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.878170 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-kube-api-access-8sll4" (OuterVolumeSpecName: "kube-api-access-8sll4") pod "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" (UID: "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2"). InnerVolumeSpecName "kube-api-access-8sll4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:38:14.878237 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.878180 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" (UID: "f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:38:14.976895 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.976855 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sll4\" (UniqueName: \"kubernetes.io/projected/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-kube-api-access-8sll4\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:38:14.976895 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.976888 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-oauth-serving-cert\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:38:14.976895 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.976898 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-service-ca\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:38:14.976895 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.976906 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-serving-cert\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:38:14.977168 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.976915 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-config\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:38:14.977168 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.976923 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-trusted-ca-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:38:14.977168 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:14.976931 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2-console-oauth-config\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:38:15.501530 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:15.501491 2560 generic.go:356] "Generic (PLEG): container finished" podID="f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" containerID="ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490" exitCode=0 Jul 29 17:38:15.501926 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:15.501556 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd49d457-dsxcp" Jul 29 17:38:15.501926 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:15.501570 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd49d457-dsxcp" event={"ID":"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2","Type":"ContainerDied","Data":"ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490"} Jul 29 17:38:15.501926 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:15.501619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd49d457-dsxcp" event={"ID":"f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2","Type":"ContainerDied","Data":"1d31b71cdb1ce36af0db4feda3c4fb18958bd01d9ac87c91af708331590049b1"} Jul 29 17:38:15.501926 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:15.501645 2560 scope.go:117] "RemoveContainer" containerID="ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490" Jul 29 17:38:15.510509 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:15.510486 2560 scope.go:117] "RemoveContainer" containerID="ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490" Jul 29 17:38:15.510823 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:38:15.510803 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490\": container with ID starting with ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490 not found: ID does not exist" containerID="ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490" Jul 29 17:38:15.510877 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:15.510833 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490"} err="failed to get container status \"ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490\": rpc error: code = NotFound desc = could not find container \"ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490\": container with ID starting with ac9a35b350dbaaaf7425090cf421f12fc8ad97200ee372269ca6cac84c700490 not found: ID does not exist" Jul 29 17:38:15.522672 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:15.522640 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd49d457-dsxcp"] Jul 29 17:38:15.525393 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:15.525370 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cd49d457-dsxcp"] Jul 29 17:38:16.488697 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:16.488660 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" path="/var/lib/kubelet/pods/f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2/volumes" Jul 29 17:38:39.833300 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.833258 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp"] Jul 29 17:38:39.833785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.833557 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" containerName="console" Jul 29 17:38:39.833785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.833569 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" containerName="console" Jul 29 17:38:39.833785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.833631 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b4e6dd-b5da-4b89-9edc-b83ec005fcc2" containerName="console" Jul 29 17:38:39.837842 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.837824 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:39.840427 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.840404 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9wkv9\"" Jul 29 17:38:39.841348 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.841331 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 17:38:39.842435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.842416 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 17:38:39.854514 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.854485 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp"] Jul 29 17:38:39.868188 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.868157 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmtcz\" (UniqueName: \"kubernetes.io/projected/66fca4a5-98ac-4591-a08d-4f329af05239-kube-api-access-mmtcz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:39.868188 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.868194 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:39.868467 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.868291 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:39.969204 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.969155 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmtcz\" (UniqueName: \"kubernetes.io/projected/66fca4a5-98ac-4591-a08d-4f329af05239-kube-api-access-mmtcz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:39.969204 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.969206 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:39.969506 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.969270 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:39.969699 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.969678 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:39.969765 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.969707 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:39.979291 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:39.979269 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmtcz\" (UniqueName: \"kubernetes.io/projected/66fca4a5-98ac-4591-a08d-4f329af05239-kube-api-access-mmtcz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:40.147588 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:40.147488 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:40.286586 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:40.286540 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp"] Jul 29 17:38:40.289405 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:38:40.289373 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fca4a5_98ac_4591_a08d_4f329af05239.slice/crio-1e7b75d1ecdb1af50d69fc63d85775802fa2af166fa576c8316d1176b30e0836 WatchSource:0}: Error finding container 1e7b75d1ecdb1af50d69fc63d85775802fa2af166fa576c8316d1176b30e0836: Status 404 returned error can't find the container with id 1e7b75d1ecdb1af50d69fc63d85775802fa2af166fa576c8316d1176b30e0836 Jul 29 17:38:40.597747 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:40.597713 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" event={"ID":"66fca4a5-98ac-4591-a08d-4f329af05239","Type":"ContainerStarted","Data":"1e7b75d1ecdb1af50d69fc63d85775802fa2af166fa576c8316d1176b30e0836"} Jul 29 17:38:48.636681 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:48.636638 2560 generic.go:356] "Generic (PLEG): container finished" podID="66fca4a5-98ac-4591-a08d-4f329af05239" containerID="38ddfa620298a2cab58d721dbedf81967b12fe8a0f411007da2394af6afffa69" exitCode=0 Jul 29 17:38:48.637059 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:48.636718 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" event={"ID":"66fca4a5-98ac-4591-a08d-4f329af05239","Type":"ContainerDied","Data":"38ddfa620298a2cab58d721dbedf81967b12fe8a0f411007da2394af6afffa69"} Jul 29 17:38:51.651508 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:51.651472 2560 generic.go:356] "Generic (PLEG): container finished" podID="66fca4a5-98ac-4591-a08d-4f329af05239" containerID="09c5224be51cb694b8d6556337f3072f496fa7427474c2a30d39d60dfd0936db" exitCode=0 Jul 29 17:38:51.651975 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:51.651534 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" event={"ID":"66fca4a5-98ac-4591-a08d-4f329af05239","Type":"ContainerDied","Data":"09c5224be51cb694b8d6556337f3072f496fa7427474c2a30d39d60dfd0936db"} Jul 29 17:38:58.682482 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:58.682443 2560 generic.go:356] "Generic (PLEG): container finished" podID="66fca4a5-98ac-4591-a08d-4f329af05239" containerID="4429b790677acdb1117fd1fa2eb568ca68fe8211cc9371eca2784933267cad1f" exitCode=0 Jul 29 17:38:58.682861 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:58.682514 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" event={"ID":"66fca4a5-98ac-4591-a08d-4f329af05239","Type":"ContainerDied","Data":"4429b790677acdb1117fd1fa2eb568ca68fe8211cc9371eca2784933267cad1f"} Jul 29 17:38:59.817665 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:59.817632 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:38:59.942835 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:59.942740 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmtcz\" (UniqueName: \"kubernetes.io/projected/66fca4a5-98ac-4591-a08d-4f329af05239-kube-api-access-mmtcz\") pod \"66fca4a5-98ac-4591-a08d-4f329af05239\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " Jul 29 17:38:59.942835 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:59.942789 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-util\") pod \"66fca4a5-98ac-4591-a08d-4f329af05239\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " Jul 29 17:38:59.942835 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:59.942837 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-bundle\") pod \"66fca4a5-98ac-4591-a08d-4f329af05239\" (UID: \"66fca4a5-98ac-4591-a08d-4f329af05239\") " Jul 29 17:38:59.943658 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:59.943578 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-bundle" (OuterVolumeSpecName: "bundle") pod "66fca4a5-98ac-4591-a08d-4f329af05239" (UID: "66fca4a5-98ac-4591-a08d-4f329af05239"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:38:59.945244 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:59.945218 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66fca4a5-98ac-4591-a08d-4f329af05239-kube-api-access-mmtcz" (OuterVolumeSpecName: "kube-api-access-mmtcz") pod "66fca4a5-98ac-4591-a08d-4f329af05239" (UID: "66fca4a5-98ac-4591-a08d-4f329af05239"). InnerVolumeSpecName "kube-api-access-mmtcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:38:59.947299 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:38:59.947276 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-util" (OuterVolumeSpecName: "util") pod "66fca4a5-98ac-4591-a08d-4f329af05239" (UID: "66fca4a5-98ac-4591-a08d-4f329af05239"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:39:00.043911 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:00.043873 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmtcz\" (UniqueName: \"kubernetes.io/projected/66fca4a5-98ac-4591-a08d-4f329af05239-kube-api-access-mmtcz\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:39:00.043911 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:00.043904 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-util\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:39:00.043911 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:00.043916 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66fca4a5-98ac-4591-a08d-4f329af05239-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:39:00.692756 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:00.692719 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" event={"ID":"66fca4a5-98ac-4591-a08d-4f329af05239","Type":"ContainerDied","Data":"1e7b75d1ecdb1af50d69fc63d85775802fa2af166fa576c8316d1176b30e0836"} Jul 29 17:39:00.692756 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:00.692741 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qrtpp" Jul 29 17:39:00.692997 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:00.692788 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e7b75d1ecdb1af50d69fc63d85775802fa2af166fa576c8316d1176b30e0836" Jul 29 17:39:07.997607 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:07.997574 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6"] Jul 29 17:39:07.998095 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:07.997847 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fca4a5-98ac-4591-a08d-4f329af05239" containerName="extract" Jul 29 17:39:07.998095 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:07.997858 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fca4a5-98ac-4591-a08d-4f329af05239" containerName="extract" Jul 29 17:39:07.998095 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:07.997875 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fca4a5-98ac-4591-a08d-4f329af05239" containerName="util" Jul 29 17:39:07.998095 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:07.997879 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fca4a5-98ac-4591-a08d-4f329af05239" containerName="util" Jul 29 17:39:07.998095 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:07.997888 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fca4a5-98ac-4591-a08d-4f329af05239" containerName="pull" Jul 29 17:39:07.998095 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:07.997893 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fca4a5-98ac-4591-a08d-4f329af05239" containerName="pull" Jul 29 17:39:07.998095 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:07.997947 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="66fca4a5-98ac-4591-a08d-4f329af05239" containerName="extract" Jul 29 17:39:08.002583 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.002562 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" Jul 29 17:39:08.004842 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.004811 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 29 17:39:08.004978 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.004870 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:39:08.005050 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.004992 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vf6wd\"" Jul 29 17:39:08.016133 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.016109 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6"] Jul 29 17:39:08.111211 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.111173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng9bd\" (UniqueName: \"kubernetes.io/projected/6cb329fc-12ad-4b57-b197-35078c1747fb-kube-api-access-ng9bd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzsm6\" (UID: \"6cb329fc-12ad-4b57-b197-35078c1747fb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" Jul 29 17:39:08.111414 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.111244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cb329fc-12ad-4b57-b197-35078c1747fb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzsm6\" (UID: \"6cb329fc-12ad-4b57-b197-35078c1747fb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" Jul 29 17:39:08.211875 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.211841 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9bd\" (UniqueName: \"kubernetes.io/projected/6cb329fc-12ad-4b57-b197-35078c1747fb-kube-api-access-ng9bd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzsm6\" (UID: \"6cb329fc-12ad-4b57-b197-35078c1747fb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" Jul 29 17:39:08.212009 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.211900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cb329fc-12ad-4b57-b197-35078c1747fb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzsm6\" (UID: \"6cb329fc-12ad-4b57-b197-35078c1747fb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" Jul 29 17:39:08.212242 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.212225 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cb329fc-12ad-4b57-b197-35078c1747fb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzsm6\" (UID: \"6cb329fc-12ad-4b57-b197-35078c1747fb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" Jul 29 17:39:08.223457 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.223429 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng9bd\" (UniqueName: \"kubernetes.io/projected/6cb329fc-12ad-4b57-b197-35078c1747fb-kube-api-access-ng9bd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mzsm6\" (UID: \"6cb329fc-12ad-4b57-b197-35078c1747fb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" Jul 29 17:39:08.311103 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.311016 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" Jul 29 17:39:08.457846 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.457823 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6"] Jul 29 17:39:08.460827 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:39:08.460794 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb329fc_12ad_4b57_b197_35078c1747fb.slice/crio-09076a008b15850c7a1c56ffa8e2722b82813a409d3e17204fb67316517e327a WatchSource:0}: Error finding container 09076a008b15850c7a1c56ffa8e2722b82813a409d3e17204fb67316517e327a: Status 404 returned error can't find the container with id 09076a008b15850c7a1c56ffa8e2722b82813a409d3e17204fb67316517e327a Jul 29 17:39:08.726875 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:08.726790 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" event={"ID":"6cb329fc-12ad-4b57-b197-35078c1747fb","Type":"ContainerStarted","Data":"09076a008b15850c7a1c56ffa8e2722b82813a409d3e17204fb67316517e327a"} Jul 29 17:39:10.738649 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:10.738551 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" event={"ID":"6cb329fc-12ad-4b57-b197-35078c1747fb","Type":"ContainerStarted","Data":"8a2359d6e7ebdfc40751acb059a7993a7cc9bac3ae1a8666e8b3cbc61f5d2616"} Jul 29 17:39:10.756877 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:10.756824 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mzsm6" podStartSLOduration=1.9061973239999999 podStartE2EDuration="3.756808017s" totalImagesPullingTime="1.850610693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:39:10.756004734 +0000 UTC m=+278.796890026" watchObservedRunningTime="2026-07-29 17:39:10.756808017 +0000 UTC m=+278.797693306" Jul 29 17:39:12.158589 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.156452 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4g447"] Jul 29 17:39:12.160880 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.159752 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:12.162357 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.162337 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 29 17:39:12.162565 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.162547 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 29 17:39:12.171914 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.171889 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4g447"] Jul 29 17:39:12.229700 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.229653 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c"] Jul 29 17:39:12.232193 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.232171 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.234799 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.234767 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 17:39:12.234968 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.234767 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9wkv9\"" Jul 29 17:39:12.234968 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.234779 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 17:39:12.242437 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.242399 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c"] Jul 29 17:39:12.247370 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.247333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ceaee605-6e84-4732-85ac-93627072ddda-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4g447\" (UID: \"ceaee605-6e84-4732-85ac-93627072ddda\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:12.247537 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.247484 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c94p6\" (UniqueName: \"kubernetes.io/projected/ceaee605-6e84-4732-85ac-93627072ddda-kube-api-access-c94p6\") pod \"cert-manager-webhook-6486ffd997-4g447\" (UID: \"ceaee605-6e84-4732-85ac-93627072ddda\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:12.348403 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.348354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.348625 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.348431 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c94p6\" (UniqueName: \"kubernetes.io/projected/ceaee605-6e84-4732-85ac-93627072ddda-kube-api-access-c94p6\") pod \"cert-manager-webhook-6486ffd997-4g447\" (UID: \"ceaee605-6e84-4732-85ac-93627072ddda\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:12.348625 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.348472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ceaee605-6e84-4732-85ac-93627072ddda-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4g447\" (UID: \"ceaee605-6e84-4732-85ac-93627072ddda\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:12.348745 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.348630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.348745 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.348668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v4fl\" (UniqueName: \"kubernetes.io/projected/0b9778ca-e3f3-44e5-8d82-fc347556dd41-kube-api-access-7v4fl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.356781 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.356748 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ceaee605-6e84-4732-85ac-93627072ddda-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4g447\" (UID: \"ceaee605-6e84-4732-85ac-93627072ddda\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:12.356941 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.356874 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c94p6\" (UniqueName: \"kubernetes.io/projected/ceaee605-6e84-4732-85ac-93627072ddda-kube-api-access-c94p6\") pod \"cert-manager-webhook-6486ffd997-4g447\" (UID: \"ceaee605-6e84-4732-85ac-93627072ddda\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:12.449935 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.449836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.449935 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.449886 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v4fl\" (UniqueName: \"kubernetes.io/projected/0b9778ca-e3f3-44e5-8d82-fc347556dd41-kube-api-access-7v4fl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.450181 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.449953 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.450375 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.450296 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.450375 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.450369 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.458773 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.458745 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v4fl\" (UniqueName: \"kubernetes.io/projected/0b9778ca-e3f3-44e5-8d82-fc347556dd41-kube-api-access-7v4fl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.488467 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.488435 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:12.543665 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.543629 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:12.634104 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.634048 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4g447"] Jul 29 17:39:12.636844 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:39:12.636807 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podceaee605_6e84_4732_85ac_93627072ddda.slice/crio-e0129b00a0b9761d4fc0a566c1276a9ba20812e0fadc8a0e25e52d2f2b9ed2bc WatchSource:0}: Error finding container e0129b00a0b9761d4fc0a566c1276a9ba20812e0fadc8a0e25e52d2f2b9ed2bc: Status 404 returned error can't find the container with id e0129b00a0b9761d4fc0a566c1276a9ba20812e0fadc8a0e25e52d2f2b9ed2bc Jul 29 17:39:12.690667 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.690637 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c"] Jul 29 17:39:12.694127 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:39:12.694100 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9778ca_e3f3_44e5_8d82_fc347556dd41.slice/crio-aad7a315f61382ec4e41fa05ac77b56dc4667749e88963b43695d678af003c42 WatchSource:0}: Error finding container aad7a315f61382ec4e41fa05ac77b56dc4667749e88963b43695d678af003c42: Status 404 returned error can't find the container with id aad7a315f61382ec4e41fa05ac77b56dc4667749e88963b43695d678af003c42 Jul 29 17:39:12.747129 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.747104 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" event={"ID":"ceaee605-6e84-4732-85ac-93627072ddda","Type":"ContainerStarted","Data":"e0129b00a0b9761d4fc0a566c1276a9ba20812e0fadc8a0e25e52d2f2b9ed2bc"} Jul 29 17:39:12.748827 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:12.748800 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" event={"ID":"0b9778ca-e3f3-44e5-8d82-fc347556dd41","Type":"ContainerStarted","Data":"aad7a315f61382ec4e41fa05ac77b56dc4667749e88963b43695d678af003c42"} Jul 29 17:39:13.757101 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:13.757069 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerID="a4d1c725cd7c87d06449c3beaaeeeb92a5c656a704059c12a6fd831bdcc94363" exitCode=0 Jul 29 17:39:13.757621 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:13.757174 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" event={"ID":"0b9778ca-e3f3-44e5-8d82-fc347556dd41","Type":"ContainerDied","Data":"a4d1c725cd7c87d06449c3beaaeeeb92a5c656a704059c12a6fd831bdcc94363"} Jul 29 17:39:15.768641 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:15.768609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" event={"ID":"ceaee605-6e84-4732-85ac-93627072ddda","Type":"ContainerStarted","Data":"18dfd4b08cac9c84bb23604b6279eda09b9ab57be96ecc228cb8d126a5d9a9bc"} Jul 29 17:39:15.769128 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:15.768827 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:15.788986 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:15.788934 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" podStartSLOduration=0.979234167 podStartE2EDuration="3.788913959s" totalImagesPullingTime="2.809679792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:39:15.788528606 +0000 UTC m=+283.829413896" watchObservedRunningTime="2026-07-29 17:39:15.788913959 +0000 UTC m=+283.829799252" Jul 29 17:39:17.780755 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:17.780720 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerID="a2f9bac9659c73b03bc6a2a66bc0999ebcfb4f1fd8dd56be99f33007b3f34ba7" exitCode=0 Jul 29 17:39:17.781226 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:17.780812 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" event={"ID":"0b9778ca-e3f3-44e5-8d82-fc347556dd41","Type":"ContainerDied","Data":"a2f9bac9659c73b03bc6a2a66bc0999ebcfb4f1fd8dd56be99f33007b3f34ba7"} Jul 29 17:39:18.786936 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:18.786899 2560 generic.go:356] "Generic (PLEG): container finished" podID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerID="c7d00ce0f81f8a8eb09fe12802a091a2f09717dbbf80bf826eb4f8e317bdc74b" exitCode=0 Jul 29 17:39:18.787358 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:18.786979 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" event={"ID":"0b9778ca-e3f3-44e5-8d82-fc347556dd41","Type":"ContainerDied","Data":"c7d00ce0f81f8a8eb09fe12802a091a2f09717dbbf80bf826eb4f8e317bdc74b"} Jul 29 17:39:19.916051 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:19.916026 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:20.014177 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.014143 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v4fl\" (UniqueName: \"kubernetes.io/projected/0b9778ca-e3f3-44e5-8d82-fc347556dd41-kube-api-access-7v4fl\") pod \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " Jul 29 17:39:20.014177 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.014184 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-bundle\") pod \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " Jul 29 17:39:20.014486 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.014228 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-util\") pod \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\" (UID: \"0b9778ca-e3f3-44e5-8d82-fc347556dd41\") " Jul 29 17:39:20.014699 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.014672 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-bundle" (OuterVolumeSpecName: "bundle") pod "0b9778ca-e3f3-44e5-8d82-fc347556dd41" (UID: "0b9778ca-e3f3-44e5-8d82-fc347556dd41"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:39:20.016579 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.016553 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b9778ca-e3f3-44e5-8d82-fc347556dd41-kube-api-access-7v4fl" (OuterVolumeSpecName: "kube-api-access-7v4fl") pod "0b9778ca-e3f3-44e5-8d82-fc347556dd41" (UID: "0b9778ca-e3f3-44e5-8d82-fc347556dd41"). InnerVolumeSpecName "kube-api-access-7v4fl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:39:20.019126 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.019108 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-util" (OuterVolumeSpecName: "util") pod "0b9778ca-e3f3-44e5-8d82-fc347556dd41" (UID: "0b9778ca-e3f3-44e5-8d82-fc347556dd41"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:39:20.115023 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.114934 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-util\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:39:20.115023 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.114961 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v4fl\" (UniqueName: \"kubernetes.io/projected/0b9778ca-e3f3-44e5-8d82-fc347556dd41-kube-api-access-7v4fl\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:39:20.115023 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.114974 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b9778ca-e3f3-44e5-8d82-fc347556dd41-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:39:20.798064 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.797979 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" event={"ID":"0b9778ca-e3f3-44e5-8d82-fc347556dd41","Type":"ContainerDied","Data":"aad7a315f61382ec4e41fa05ac77b56dc4667749e88963b43695d678af003c42"} Jul 29 17:39:20.798064 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.798029 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aad7a315f61382ec4e41fa05ac77b56dc4667749e88963b43695d678af003c42" Jul 29 17:39:20.798064 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:20.797989 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftpv4c" Jul 29 17:39:21.776763 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:21.776734 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4g447" Jul 29 17:39:22.903872 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.903836 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nk67k"] Jul 29 17:39:22.904241 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.904157 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerName="pull" Jul 29 17:39:22.904241 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.904170 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerName="pull" Jul 29 17:39:22.904241 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.904188 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerName="util" Jul 29 17:39:22.904241 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.904196 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerName="util" Jul 29 17:39:22.904241 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.904209 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerName="extract" Jul 29 17:39:22.904241 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.904214 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerName="extract" Jul 29 17:39:22.904451 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.904278 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b9778ca-e3f3-44e5-8d82-fc347556dd41" containerName="extract" Jul 29 17:39:22.907129 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.907112 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nk67k" Jul 29 17:39:22.909429 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.909401 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vzlln\"" Jul 29 17:39:22.916871 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.916849 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nk67k"] Jul 29 17:39:22.935553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.935525 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpcjp\" (UniqueName: \"kubernetes.io/projected/3893d730-95c4-403e-a6fb-62d9c7a283a5-kube-api-access-lpcjp\") pod \"cert-manager-55b4d954d5-nk67k\" (UID: \"3893d730-95c4-403e-a6fb-62d9c7a283a5\") " pod="cert-manager/cert-manager-55b4d954d5-nk67k" Jul 29 17:39:22.935553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:22.935555 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3893d730-95c4-403e-a6fb-62d9c7a283a5-bound-sa-token\") pod \"cert-manager-55b4d954d5-nk67k\" (UID: \"3893d730-95c4-403e-a6fb-62d9c7a283a5\") " pod="cert-manager/cert-manager-55b4d954d5-nk67k" Jul 29 17:39:23.035889 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:23.035853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpcjp\" (UniqueName: \"kubernetes.io/projected/3893d730-95c4-403e-a6fb-62d9c7a283a5-kube-api-access-lpcjp\") pod \"cert-manager-55b4d954d5-nk67k\" (UID: \"3893d730-95c4-403e-a6fb-62d9c7a283a5\") " pod="cert-manager/cert-manager-55b4d954d5-nk67k" Jul 29 17:39:23.035889 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:23.035891 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3893d730-95c4-403e-a6fb-62d9c7a283a5-bound-sa-token\") pod \"cert-manager-55b4d954d5-nk67k\" (UID: \"3893d730-95c4-403e-a6fb-62d9c7a283a5\") " pod="cert-manager/cert-manager-55b4d954d5-nk67k" Jul 29 17:39:23.044217 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:23.044180 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3893d730-95c4-403e-a6fb-62d9c7a283a5-bound-sa-token\") pod \"cert-manager-55b4d954d5-nk67k\" (UID: \"3893d730-95c4-403e-a6fb-62d9c7a283a5\") " pod="cert-manager/cert-manager-55b4d954d5-nk67k" Jul 29 17:39:23.044404 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:23.044384 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpcjp\" (UniqueName: \"kubernetes.io/projected/3893d730-95c4-403e-a6fb-62d9c7a283a5-kube-api-access-lpcjp\") pod \"cert-manager-55b4d954d5-nk67k\" (UID: \"3893d730-95c4-403e-a6fb-62d9c7a283a5\") " pod="cert-manager/cert-manager-55b4d954d5-nk67k" Jul 29 17:39:23.217224 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:23.217133 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nk67k" Jul 29 17:39:23.349948 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:23.349917 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nk67k"] Jul 29 17:39:23.353486 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:39:23.353454 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3893d730_95c4_403e_a6fb_62d9c7a283a5.slice/crio-b71fe3fe187cc7d822760a7595c1abe193810b7c63e2b07505b60a3e27e67d12 WatchSource:0}: Error finding container b71fe3fe187cc7d822760a7595c1abe193810b7c63e2b07505b60a3e27e67d12: Status 404 returned error can't find the container with id b71fe3fe187cc7d822760a7595c1abe193810b7c63e2b07505b60a3e27e67d12 Jul 29 17:39:23.812220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:23.812187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nk67k" event={"ID":"3893d730-95c4-403e-a6fb-62d9c7a283a5","Type":"ContainerStarted","Data":"2b165ef594f4a8a72d91ba20b65e590be0bc89b5de9a4d2aaf17a03816551e83"} Jul 29 17:39:23.812220 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:23.812228 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nk67k" event={"ID":"3893d730-95c4-403e-a6fb-62d9c7a283a5","Type":"ContainerStarted","Data":"b71fe3fe187cc7d822760a7595c1abe193810b7c63e2b07505b60a3e27e67d12"} Jul 29 17:39:23.829604 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:23.829545 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nk67k" podStartSLOduration=1.829527549 podStartE2EDuration="1.829527549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:39:23.828495009 +0000 UTC m=+291.869380302" watchObservedRunningTime="2026-07-29 17:39:23.829527549 +0000 UTC m=+291.870412839" Jul 29 17:39:32.349607 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.349579 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/1.log" Jul 29 17:39:32.355173 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.355140 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/1.log" Jul 29 17:39:32.363473 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.363447 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 17:39:32.566920 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.566885 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8"] Jul 29 17:39:32.569023 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.569007 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.571363 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.571339 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 17:39:32.571493 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.571368 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9wkv9\"" Jul 29 17:39:32.571493 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.571341 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 17:39:32.579064 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.579039 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8"] Jul 29 17:39:32.611152 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.611059 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.611152 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.611095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4zj6\" (UniqueName: \"kubernetes.io/projected/142c73de-c671-4575-b0d6-b53a1eb199c9-kube-api-access-z4zj6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.611152 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.611124 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.711785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.711747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.711785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.711786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4zj6\" (UniqueName: \"kubernetes.io/projected/142c73de-c671-4575-b0d6-b53a1eb199c9-kube-api-access-z4zj6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.712014 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.711809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.712259 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.712241 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.712321 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.712249 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.721713 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.721686 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4zj6\" (UniqueName: \"kubernetes.io/projected/142c73de-c671-4575-b0d6-b53a1eb199c9-kube-api-access-z4zj6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:32.878426 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:32.878337 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:33.012133 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:33.012099 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8"] Jul 29 17:39:33.014979 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:39:33.014949 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142c73de_c671_4575_b0d6_b53a1eb199c9.slice/crio-dfd78b13228c45627d1d1ff6b443f98ed0936ca745110961ac3c75ec60470ae5 WatchSource:0}: Error finding container dfd78b13228c45627d1d1ff6b443f98ed0936ca745110961ac3c75ec60470ae5: Status 404 returned error can't find the container with id dfd78b13228c45627d1d1ff6b443f98ed0936ca745110961ac3c75ec60470ae5 Jul 29 17:39:33.858206 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:33.858171 2560 generic.go:356] "Generic (PLEG): container finished" podID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerID="8cfbd6c2b36002b65afc5c522c298b66b23dc0c9240742026e1c2c6ac682ffff" exitCode=0 Jul 29 17:39:33.858616 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:33.858251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" event={"ID":"142c73de-c671-4575-b0d6-b53a1eb199c9","Type":"ContainerDied","Data":"8cfbd6c2b36002b65afc5c522c298b66b23dc0c9240742026e1c2c6ac682ffff"} Jul 29 17:39:33.858616 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:33.858300 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" event={"ID":"142c73de-c671-4575-b0d6-b53a1eb199c9","Type":"ContainerStarted","Data":"dfd78b13228c45627d1d1ff6b443f98ed0936ca745110961ac3c75ec60470ae5"} Jul 29 17:39:33.858841 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:33.858824 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:39:34.864128 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:34.864096 2560 generic.go:356] "Generic (PLEG): container finished" podID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerID="e69badd2e65cf57052fed705aa06d8946c6536dc9db5e2c7465c116cb8c1d086" exitCode=0 Jul 29 17:39:34.864560 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:34.864175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" event={"ID":"142c73de-c671-4575-b0d6-b53a1eb199c9","Type":"ContainerDied","Data":"e69badd2e65cf57052fed705aa06d8946c6536dc9db5e2c7465c116cb8c1d086"} Jul 29 17:39:35.871000 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:35.870959 2560 generic.go:356] "Generic (PLEG): container finished" podID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerID="ed39eedf55b01d0a6045926c9ed8ee3a1e2b222092d5dceeb75a3e542961f2e7" exitCode=0 Jul 29 17:39:35.871437 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:35.871042 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" event={"ID":"142c73de-c671-4575-b0d6-b53a1eb199c9","Type":"ContainerDied","Data":"ed39eedf55b01d0a6045926c9ed8ee3a1e2b222092d5dceeb75a3e542961f2e7"} Jul 29 17:39:37.020135 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.020103 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:37.051712 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.051684 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4zj6\" (UniqueName: \"kubernetes.io/projected/142c73de-c671-4575-b0d6-b53a1eb199c9-kube-api-access-z4zj6\") pod \"142c73de-c671-4575-b0d6-b53a1eb199c9\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " Jul 29 17:39:37.051897 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.051747 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-util\") pod \"142c73de-c671-4575-b0d6-b53a1eb199c9\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " Jul 29 17:39:37.051897 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.051807 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-bundle\") pod \"142c73de-c671-4575-b0d6-b53a1eb199c9\" (UID: \"142c73de-c671-4575-b0d6-b53a1eb199c9\") " Jul 29 17:39:37.052602 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.052543 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-bundle" (OuterVolumeSpecName: "bundle") pod "142c73de-c671-4575-b0d6-b53a1eb199c9" (UID: "142c73de-c671-4575-b0d6-b53a1eb199c9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:39:37.053991 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.053964 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/142c73de-c671-4575-b0d6-b53a1eb199c9-kube-api-access-z4zj6" (OuterVolumeSpecName: "kube-api-access-z4zj6") pod "142c73de-c671-4575-b0d6-b53a1eb199c9" (UID: "142c73de-c671-4575-b0d6-b53a1eb199c9"). InnerVolumeSpecName "kube-api-access-z4zj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:39:37.060435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.060382 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-util" (OuterVolumeSpecName: "util") pod "142c73de-c671-4575-b0d6-b53a1eb199c9" (UID: "142c73de-c671-4575-b0d6-b53a1eb199c9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:39:37.152647 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.152564 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:39:37.152647 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.152591 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4zj6\" (UniqueName: \"kubernetes.io/projected/142c73de-c671-4575-b0d6-b53a1eb199c9-kube-api-access-z4zj6\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:39:37.152647 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.152601 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/142c73de-c671-4575-b0d6-b53a1eb199c9-util\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:39:37.881478 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.881443 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" event={"ID":"142c73de-c671-4575-b0d6-b53a1eb199c9","Type":"ContainerDied","Data":"dfd78b13228c45627d1d1ff6b443f98ed0936ca745110961ac3c75ec60470ae5"} Jul 29 17:39:37.881478 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.881472 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7zdl8" Jul 29 17:39:37.881478 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:37.881495 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfd78b13228c45627d1d1ff6b443f98ed0936ca745110961ac3c75ec60470ae5" Jul 29 17:39:49.935859 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.935820 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms"] Jul 29 17:39:49.936425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.936256 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerName="extract" Jul 29 17:39:49.936425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.936274 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerName="extract" Jul 29 17:39:49.936425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.936287 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerName="util" Jul 29 17:39:49.936425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.936295 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerName="util" Jul 29 17:39:49.936425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.936323 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerName="pull" Jul 29 17:39:49.936425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.936332 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerName="pull" Jul 29 17:39:49.936722 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.936432 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="142c73de-c671-4575-b0d6-b53a1eb199c9" containerName="extract" Jul 29 17:39:49.940967 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.940942 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:49.943550 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.943518 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 17:39:49.943550 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.943544 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 29 17:39:49.944256 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.944242 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 17:39:49.944323 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.944267 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 29 17:39:49.944435 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.944413 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2czn8\"" Jul 29 17:39:49.957825 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:49.957788 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms"] Jul 29 17:39:50.055949 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.055906 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/621f5e84-3ced-480b-acf2-6d1b53fc6f90-tmp\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.056148 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.055963 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/621f5e84-3ced-480b-acf2-6d1b53fc6f90-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.056148 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.056007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/621f5e84-3ced-480b-acf2-6d1b53fc6f90-manifests\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.056148 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.056032 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwd6b\" (UniqueName: \"kubernetes.io/projected/621f5e84-3ced-480b-acf2-6d1b53fc6f90-kube-api-access-mwd6b\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.056148 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.056052 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/621f5e84-3ced-480b-acf2-6d1b53fc6f90-webhook-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.156851 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.156811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/621f5e84-3ced-480b-acf2-6d1b53fc6f90-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.156851 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.156860 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/621f5e84-3ced-480b-acf2-6d1b53fc6f90-manifests\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.157133 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.156902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwd6b\" (UniqueName: \"kubernetes.io/projected/621f5e84-3ced-480b-acf2-6d1b53fc6f90-kube-api-access-mwd6b\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.157133 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.156927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/621f5e84-3ced-480b-acf2-6d1b53fc6f90-webhook-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.157133 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.156999 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/621f5e84-3ced-480b-acf2-6d1b53fc6f90-tmp\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.157433 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.157401 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/621f5e84-3ced-480b-acf2-6d1b53fc6f90-manifests\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.159404 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.159382 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/621f5e84-3ced-480b-acf2-6d1b53fc6f90-tmp\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.159740 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.159722 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/621f5e84-3ced-480b-acf2-6d1b53fc6f90-webhook-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.159789 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.159720 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/621f5e84-3ced-480b-acf2-6d1b53fc6f90-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.165290 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.165263 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwd6b\" (UniqueName: \"kubernetes.io/projected/621f5e84-3ced-480b-acf2-6d1b53fc6f90-kube-api-access-mwd6b\") pod \"opendatahub-operator-controller-manager-78ccbc8659-vvfms\" (UID: \"621f5e84-3ced-480b-acf2-6d1b53fc6f90\") " pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.252041 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.252001 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:50.425345 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.425290 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms"] Jul 29 17:39:50.432116 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:39:50.432086 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621f5e84_3ced_480b_acf2_6d1b53fc6f90.slice/crio-0ae5ac893b5949686b0e689b17847f4a058a381fe563f0c63af5c8fda7002c42 WatchSource:0}: Error finding container 0ae5ac893b5949686b0e689b17847f4a058a381fe563f0c63af5c8fda7002c42: Status 404 returned error can't find the container with id 0ae5ac893b5949686b0e689b17847f4a058a381fe563f0c63af5c8fda7002c42 Jul 29 17:39:50.944004 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:50.943958 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" event={"ID":"621f5e84-3ced-480b-acf2-6d1b53fc6f90","Type":"ContainerStarted","Data":"0ae5ac893b5949686b0e689b17847f4a058a381fe563f0c63af5c8fda7002c42"} Jul 29 17:39:53.961457 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:53.961421 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" event={"ID":"621f5e84-3ced-480b-acf2-6d1b53fc6f90","Type":"ContainerStarted","Data":"21774b9909cbd5f9e92b51acdb12a49e75227b5411811c9135defece4c852c94"} Jul 29 17:39:54.967728 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:54.967639 2560 generic.go:356] "Generic (PLEG): container finished" podID="621f5e84-3ced-480b-acf2-6d1b53fc6f90" containerID="21774b9909cbd5f9e92b51acdb12a49e75227b5411811c9135defece4c852c94" exitCode=0 Jul 29 17:39:54.968119 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:54.967731 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" event={"ID":"621f5e84-3ced-480b-acf2-6d1b53fc6f90","Type":"ContainerDied","Data":"21774b9909cbd5f9e92b51acdb12a49e75227b5411811c9135defece4c852c94"} Jul 29 17:39:55.974852 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:55.974814 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" event={"ID":"621f5e84-3ced-480b-acf2-6d1b53fc6f90","Type":"ContainerStarted","Data":"c8e067dd058ccc844668ae832ce481f045ae70d28d6fe22bf8691da93ed4b1d5"} Jul 29 17:39:55.975266 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:55.974906 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:39:55.996089 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:39:55.996037 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" podStartSLOduration=2.484570616 podStartE2EDuration="6.996019691s" totalImagesPullingTime="3.470944816s" totalInitContainerRuntime="1.040504259s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:39:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:39:55.994205131 +0000 UTC m=+324.035090432" watchObservedRunningTime="2026-07-29 17:39:55.996019691 +0000 UTC m=+324.036904980" Jul 29 17:40:06.981960 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:06.981924 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78ccbc8659-vvfms" Jul 29 17:40:09.621238 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.621203 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c7886b686-rzc26"] Jul 29 17:40:09.630107 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.630083 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.632953 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.632928 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 29 17:40:09.633096 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.632970 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 29 17:40:09.633789 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.633775 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zndbs\"" Jul 29 17:40:09.639931 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.639900 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c7886b686-rzc26"] Jul 29 17:40:09.728152 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.728116 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6lfw\" (UniqueName: \"kubernetes.io/projected/3fea3ef9-7851-4a34-89be-34341c2a8870-kube-api-access-q6lfw\") pod \"kube-auth-proxy-5c7886b686-rzc26\" (UID: \"3fea3ef9-7851-4a34-89be-34341c2a8870\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.728353 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.728167 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fea3ef9-7851-4a34-89be-34341c2a8870-tls-certs\") pod \"kube-auth-proxy-5c7886b686-rzc26\" (UID: \"3fea3ef9-7851-4a34-89be-34341c2a8870\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.728353 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.728261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fea3ef9-7851-4a34-89be-34341c2a8870-tmp\") pod \"kube-auth-proxy-5c7886b686-rzc26\" (UID: \"3fea3ef9-7851-4a34-89be-34341c2a8870\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.829454 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.829414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fea3ef9-7851-4a34-89be-34341c2a8870-tmp\") pod \"kube-auth-proxy-5c7886b686-rzc26\" (UID: \"3fea3ef9-7851-4a34-89be-34341c2a8870\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.829682 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.829476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6lfw\" (UniqueName: \"kubernetes.io/projected/3fea3ef9-7851-4a34-89be-34341c2a8870-kube-api-access-q6lfw\") pod \"kube-auth-proxy-5c7886b686-rzc26\" (UID: \"3fea3ef9-7851-4a34-89be-34341c2a8870\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.829682 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.829514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fea3ef9-7851-4a34-89be-34341c2a8870-tls-certs\") pod \"kube-auth-proxy-5c7886b686-rzc26\" (UID: \"3fea3ef9-7851-4a34-89be-34341c2a8870\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.831991 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.831955 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fea3ef9-7851-4a34-89be-34341c2a8870-tmp\") pod \"kube-auth-proxy-5c7886b686-rzc26\" (UID: \"3fea3ef9-7851-4a34-89be-34341c2a8870\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.832183 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.832163 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fea3ef9-7851-4a34-89be-34341c2a8870-tls-certs\") pod \"kube-auth-proxy-5c7886b686-rzc26\" (UID: \"3fea3ef9-7851-4a34-89be-34341c2a8870\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.850169 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.850137 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6lfw\" (UniqueName: \"kubernetes.io/projected/3fea3ef9-7851-4a34-89be-34341c2a8870-kube-api-access-q6lfw\") pod \"kube-auth-proxy-5c7886b686-rzc26\" (UID: \"3fea3ef9-7851-4a34-89be-34341c2a8870\") " pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:09.857477 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.857449 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2vw78"] Jul 29 17:40:09.860944 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.860925 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:09.865547 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.865523 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 29 17:40:09.868050 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.868030 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-svxw8\"" Jul 29 17:40:09.883228 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.883153 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2vw78"] Jul 29 17:40:09.946581 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:09.946542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" Jul 29 17:40:10.031415 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.031376 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6be5f85a-54d8-43e6-ad0a-8579d2a22c33-cert\") pod \"odh-model-controller-7998c67dc4-2vw78\" (UID: \"6be5f85a-54d8-43e6-ad0a-8579d2a22c33\") " pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:10.031582 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.031466 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpc9v\" (UniqueName: \"kubernetes.io/projected/6be5f85a-54d8-43e6-ad0a-8579d2a22c33-kube-api-access-cpc9v\") pod \"odh-model-controller-7998c67dc4-2vw78\" (UID: \"6be5f85a-54d8-43e6-ad0a-8579d2a22c33\") " pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:10.107754 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.107727 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c7886b686-rzc26"] Jul 29 17:40:10.109107 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:40:10.109078 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fea3ef9_7851_4a34_89be_34341c2a8870.slice/crio-f0079561b270dea29ff115876e037a31ab58fc4cad493b7ba096ca9b10cf63c5 WatchSource:0}: Error finding container f0079561b270dea29ff115876e037a31ab58fc4cad493b7ba096ca9b10cf63c5: Status 404 returned error can't find the container with id f0079561b270dea29ff115876e037a31ab58fc4cad493b7ba096ca9b10cf63c5 Jul 29 17:40:10.132481 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.132437 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpc9v\" (UniqueName: \"kubernetes.io/projected/6be5f85a-54d8-43e6-ad0a-8579d2a22c33-kube-api-access-cpc9v\") pod \"odh-model-controller-7998c67dc4-2vw78\" (UID: \"6be5f85a-54d8-43e6-ad0a-8579d2a22c33\") " pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:10.132672 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.132526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6be5f85a-54d8-43e6-ad0a-8579d2a22c33-cert\") pod \"odh-model-controller-7998c67dc4-2vw78\" (UID: \"6be5f85a-54d8-43e6-ad0a-8579d2a22c33\") " pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:10.135199 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.135139 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6be5f85a-54d8-43e6-ad0a-8579d2a22c33-cert\") pod \"odh-model-controller-7998c67dc4-2vw78\" (UID: \"6be5f85a-54d8-43e6-ad0a-8579d2a22c33\") " pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:10.145853 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.145820 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpc9v\" (UniqueName: \"kubernetes.io/projected/6be5f85a-54d8-43e6-ad0a-8579d2a22c33-kube-api-access-cpc9v\") pod \"odh-model-controller-7998c67dc4-2vw78\" (UID: \"6be5f85a-54d8-43e6-ad0a-8579d2a22c33\") " pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:10.170718 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.170679 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:10.310250 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.310157 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2vw78"] Jul 29 17:40:10.312380 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:40:10.312345 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be5f85a_54d8_43e6_ad0a_8579d2a22c33.slice/crio-58a91556f4e992441b7641b463cab2421ffd051d11124494290edcb7f519dbe4 WatchSource:0}: Error finding container 58a91556f4e992441b7641b463cab2421ffd051d11124494290edcb7f519dbe4: Status 404 returned error can't find the container with id 58a91556f4e992441b7641b463cab2421ffd051d11124494290edcb7f519dbe4 Jul 29 17:40:10.809289 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.809253 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkv84"] Jul 29 17:40:10.812551 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.812527 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:10.814923 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.814905 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 29 17:40:10.814998 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.814949 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tk92m\"" Jul 29 17:40:10.823018 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.822990 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkv84"] Jul 29 17:40:10.939728 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.939691 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ssvg\" (UniqueName: \"kubernetes.io/projected/e5c6250e-8df4-4f28-883d-0052f501efc9-kube-api-access-9ssvg\") pod \"model-serving-api-54d89bd5fc-rkv84\" (UID: \"e5c6250e-8df4-4f28-883d-0052f501efc9\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:10.939933 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:10.939837 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5c6250e-8df4-4f28-883d-0052f501efc9-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkv84\" (UID: \"e5c6250e-8df4-4f28-883d-0052f501efc9\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:11.040681 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.040643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ssvg\" (UniqueName: \"kubernetes.io/projected/e5c6250e-8df4-4f28-883d-0052f501efc9-kube-api-access-9ssvg\") pod \"model-serving-api-54d89bd5fc-rkv84\" (UID: \"e5c6250e-8df4-4f28-883d-0052f501efc9\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:11.040878 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.040780 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5c6250e-8df4-4f28-883d-0052f501efc9-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkv84\" (UID: \"e5c6250e-8df4-4f28-883d-0052f501efc9\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:11.040939 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:40:11.040912 2560 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 29 17:40:11.040989 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:40:11.040977 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5c6250e-8df4-4f28-883d-0052f501efc9-tls-certs podName:e5c6250e-8df4-4f28-883d-0052f501efc9 nodeName:}" failed. No retries permitted until 2026-07-29 17:40:11.540955766 +0000 UTC m=+339.581841049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e5c6250e-8df4-4f28-883d-0052f501efc9-tls-certs") pod "model-serving-api-54d89bd5fc-rkv84" (UID: "e5c6250e-8df4-4f28-883d-0052f501efc9") : secret "model-serving-api-tls" not found Jul 29 17:40:11.044937 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.044904 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" event={"ID":"6be5f85a-54d8-43e6-ad0a-8579d2a22c33","Type":"ContainerStarted","Data":"58a91556f4e992441b7641b463cab2421ffd051d11124494290edcb7f519dbe4"} Jul 29 17:40:11.046596 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.046556 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" event={"ID":"3fea3ef9-7851-4a34-89be-34341c2a8870","Type":"ContainerStarted","Data":"f0079561b270dea29ff115876e037a31ab58fc4cad493b7ba096ca9b10cf63c5"} Jul 29 17:40:11.053990 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.053963 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ssvg\" (UniqueName: \"kubernetes.io/projected/e5c6250e-8df4-4f28-883d-0052f501efc9-kube-api-access-9ssvg\") pod \"model-serving-api-54d89bd5fc-rkv84\" (UID: \"e5c6250e-8df4-4f28-883d-0052f501efc9\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:11.132235 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.132143 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg"] Jul 29 17:40:11.136917 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.135925 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.138569 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.138361 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cld5s\"" Jul 29 17:40:11.138918 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.138894 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 29 17:40:11.139098 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.139084 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 29 17:40:11.139266 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.139248 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 29 17:40:11.139467 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.139450 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 29 17:40:11.153396 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.153361 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg"] Jul 29 17:40:11.241852 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.241806 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.242113 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.241899 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dldgl\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-kube-api-access-dldgl\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.242113 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.241942 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17caf053-4398-4152-9474-681bf3f67910-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.242113 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.241973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.242113 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.242003 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17caf053-4398-4152-9474-681bf3f67910-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.242113 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.242045 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.242113 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.242085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.343271 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.343232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dldgl\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-kube-api-access-dldgl\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.343504 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.343319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17caf053-4398-4152-9474-681bf3f67910-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.343999 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.343961 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.344103 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.344020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17caf053-4398-4152-9474-681bf3f67910-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.344516 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.344483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.344640 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.344537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.344640 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.344606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.344839 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.344649 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17caf053-4398-4152-9474-681bf3f67910-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.346679 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.346652 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17caf053-4398-4152-9474-681bf3f67910-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.347446 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.347369 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.347863 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.347836 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.348676 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.348653 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.352564 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.352352 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dldgl\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-kube-api-access-dldgl\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.354422 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.354398 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cbwkg\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.456443 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.456348 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:11.546133 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.545949 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5c6250e-8df4-4f28-883d-0052f501efc9-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkv84\" (UID: \"e5c6250e-8df4-4f28-883d-0052f501efc9\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:11.549605 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.549520 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5c6250e-8df4-4f28-883d-0052f501efc9-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkv84\" (UID: \"e5c6250e-8df4-4f28-883d-0052f501efc9\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:11.697102 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.697068 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg"] Jul 29 17:40:11.700366 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:40:11.700330 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17caf053_4398_4152_9474_681bf3f67910.slice/crio-cecefb4e658fe8d2b7865a4597a12d58d08eda35a6076f90f0f0a4eca538b502 WatchSource:0}: Error finding container cecefb4e658fe8d2b7865a4597a12d58d08eda35a6076f90f0f0a4eca538b502: Status 404 returned error can't find the container with id cecefb4e658fe8d2b7865a4597a12d58d08eda35a6076f90f0f0a4eca538b502 Jul 29 17:40:11.724014 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.723963 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:11.902098 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:11.901907 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkv84"] Jul 29 17:40:11.907406 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:40:11.907375 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c6250e_8df4_4f28_883d_0052f501efc9.slice/crio-f4618166044d592708da5131bb9d54192ec5831a800265507f7d45f9eeb35ba8 WatchSource:0}: Error finding container f4618166044d592708da5131bb9d54192ec5831a800265507f7d45f9eeb35ba8: Status 404 returned error can't find the container with id f4618166044d592708da5131bb9d54192ec5831a800265507f7d45f9eeb35ba8 Jul 29 17:40:12.053748 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:12.053711 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" event={"ID":"e5c6250e-8df4-4f28-883d-0052f501efc9","Type":"ContainerStarted","Data":"f4618166044d592708da5131bb9d54192ec5831a800265507f7d45f9eeb35ba8"} Jul 29 17:40:12.055404 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:12.055374 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" event={"ID":"17caf053-4398-4152-9474-681bf3f67910","Type":"ContainerStarted","Data":"cecefb4e658fe8d2b7865a4597a12d58d08eda35a6076f90f0f0a4eca538b502"} Jul 29 17:40:15.074744 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:15.074694 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" event={"ID":"6be5f85a-54d8-43e6-ad0a-8579d2a22c33","Type":"ContainerStarted","Data":"5759387052ee44355449f2ce06b284e0d9bb4bab9462cf942f71283ff2f58a4a"} Jul 29 17:40:15.075237 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:15.074787 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:15.076699 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:15.076673 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" event={"ID":"3fea3ef9-7851-4a34-89be-34341c2a8870","Type":"ContainerStarted","Data":"a31bde78988aabb083f68855d3a2607702702f262336db81df70595b5d5c9c1c"} Jul 29 17:40:15.090911 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:15.090860 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" podStartSLOduration=2.331468196 podStartE2EDuration="6.090844858s" totalImagesPullingTime="3.759376662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:15.089631719 +0000 UTC m=+343.130517029" watchObservedRunningTime="2026-07-29 17:40:15.090844858 +0000 UTC m=+343.131730149" Jul 29 17:40:15.105199 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:15.104817 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c7886b686-rzc26" podStartSLOduration=2.142720157 podStartE2EDuration="6.104795967s" totalImagesPullingTime="3.96207581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:15.104174577 +0000 UTC m=+343.145059963" watchObservedRunningTime="2026-07-29 17:40:15.104795967 +0000 UTC m=+343.145681257" Jul 29 17:40:15.754536 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:15.754490 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 29 17:40:15.754629 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:15.754581 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 29 17:40:16.084892 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:16.084839 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" event={"ID":"17caf053-4398-4152-9474-681bf3f67910","Type":"ContainerStarted","Data":"fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461"} Jul 29 17:40:16.085369 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:16.085025 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:16.086542 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:16.086498 2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-cbwkg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 29 17:40:16.086697 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:16.086566 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" podUID="17caf053-4398-4152-9474-681bf3f67910" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 17:40:16.086758 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:16.086709 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" event={"ID":"e5c6250e-8df4-4f28-883d-0052f501efc9","Type":"ContainerStarted","Data":"759543eb0c893920d5fe775f0edd30f58b64c132fd5790988f54a794cb0b3b1e"} Jul 29 17:40:16.086830 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:16.086803 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:16.107412 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:16.107355 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" podStartSLOduration=1.057055228 podStartE2EDuration="5.107339183s" totalImagesPullingTime="4.050283955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:16.105336191 +0000 UTC m=+344.146221492" watchObservedRunningTime="2026-07-29 17:40:16.107339183 +0000 UTC m=+344.148224473" Jul 29 17:40:16.125954 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:16.125898 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" podStartSLOduration=2.33867956 podStartE2EDuration="6.125879947s" totalImagesPullingTime="3.787200387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:16.12497904 +0000 UTC m=+344.165864356" watchObservedRunningTime="2026-07-29 17:40:16.125879947 +0000 UTC m=+344.166765242" Jul 29 17:40:17.092701 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:17.092673 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:18.112983 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.112950 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n"] Jul 29 17:40:18.116627 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.116597 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.119101 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.119076 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 29 17:40:18.119294 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.119281 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 29 17:40:18.119731 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.119708 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 29 17:40:18.119854 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.119715 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 29 17:40:18.119854 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.119807 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vb7c2\"" Jul 29 17:40:18.119854 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.119807 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 29 17:40:18.126382 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.126359 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n"] Jul 29 17:40:18.202951 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.202913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeca2efd-6a3c-4185-b974-59892733182b-cert\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.202951 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.202951 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeca2efd-6a3c-4185-b974-59892733182b-metrics-cert\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.203176 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.202991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eeca2efd-6a3c-4185-b974-59892733182b-manager-config\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.203176 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.203051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh5gg\" (UniqueName: \"kubernetes.io/projected/eeca2efd-6a3c-4185-b974-59892733182b-kube-api-access-mh5gg\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.304399 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.304355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeca2efd-6a3c-4185-b974-59892733182b-cert\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.304399 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.304398 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeca2efd-6a3c-4185-b974-59892733182b-metrics-cert\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.304619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.304436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eeca2efd-6a3c-4185-b974-59892733182b-manager-config\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.304619 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.304487 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5gg\" (UniqueName: \"kubernetes.io/projected/eeca2efd-6a3c-4185-b974-59892733182b-kube-api-access-mh5gg\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.305205 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.305186 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eeca2efd-6a3c-4185-b974-59892733182b-manager-config\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.307091 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.307071 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeca2efd-6a3c-4185-b974-59892733182b-metrics-cert\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.307160 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.307092 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeca2efd-6a3c-4185-b974-59892733182b-cert\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.317333 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.317275 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh5gg\" (UniqueName: \"kubernetes.io/projected/eeca2efd-6a3c-4185-b974-59892733182b-kube-api-access-mh5gg\") pod \"lws-controller-manager-657444d86f-5fp9n\" (UID: \"eeca2efd-6a3c-4185-b974-59892733182b\") " pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.428153 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.428061 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:18.570337 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:18.570292 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n"] Jul 29 17:40:18.572552 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:40:18.572525 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeca2efd_6a3c_4185_b974_59892733182b.slice/crio-ff6027d9510517418dc9eb7ffd207b52a08ed1123c61b7e62a3ee2e188b0605d WatchSource:0}: Error finding container ff6027d9510517418dc9eb7ffd207b52a08ed1123c61b7e62a3ee2e188b0605d: Status 404 returned error can't find the container with id ff6027d9510517418dc9eb7ffd207b52a08ed1123c61b7e62a3ee2e188b0605d Jul 29 17:40:19.105225 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:19.105192 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" event={"ID":"eeca2efd-6a3c-4185-b974-59892733182b","Type":"ContainerStarted","Data":"ff6027d9510517418dc9eb7ffd207b52a08ed1123c61b7e62a3ee2e188b0605d"} Jul 29 17:40:21.118066 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:21.118026 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" event={"ID":"eeca2efd-6a3c-4185-b974-59892733182b","Type":"ContainerStarted","Data":"02a88490bd9c4ce8dac28e0c80d4a438c1e7702e9520b0df301e7e23b7b8ff58"} Jul 29 17:40:21.118513 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:21.118111 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:40:21.138266 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:21.138217 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" podStartSLOduration=1.618988185 podStartE2EDuration="3.138201826s" totalImagesPullingTime="1.519213641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:40:21.137419361 +0000 UTC m=+349.178304676" watchObservedRunningTime="2026-07-29 17:40:21.138201826 +0000 UTC m=+349.179087115" Jul 29 17:40:23.296047 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.295955 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg"] Jul 29 17:40:23.296495 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.296205 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" podUID="17caf053-4398-4152-9474-681bf3f67910" containerName="discovery" containerID="cri-o://fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461" gracePeriod=30 Jul 29 17:40:23.542526 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.542500 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:23.653104 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.653012 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-csr-dns-cert\") pod \"17caf053-4398-4152-9474-681bf3f67910\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " Jul 29 17:40:23.653104 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.653059 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-istio-token\") pod \"17caf053-4398-4152-9474-681bf3f67910\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " Jul 29 17:40:23.653104 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.653084 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17caf053-4398-4152-9474-681bf3f67910-istio-csr-ca-configmap\") pod \"17caf053-4398-4152-9474-681bf3f67910\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " Jul 29 17:40:23.653104 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.653106 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-kubeconfig\") pod \"17caf053-4398-4152-9474-681bf3f67910\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " Jul 29 17:40:23.653551 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.653152 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-cacerts\") pod \"17caf053-4398-4152-9474-681bf3f67910\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " Jul 29 17:40:23.653551 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.653171 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dldgl\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-kube-api-access-dldgl\") pod \"17caf053-4398-4152-9474-681bf3f67910\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " Jul 29 17:40:23.653551 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.653201 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17caf053-4398-4152-9474-681bf3f67910-local-certs\") pod \"17caf053-4398-4152-9474-681bf3f67910\" (UID: \"17caf053-4398-4152-9474-681bf3f67910\") " Jul 29 17:40:23.653551 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.653532 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17caf053-4398-4152-9474-681bf3f67910-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "17caf053-4398-4152-9474-681bf3f67910" (UID: "17caf053-4398-4152-9474-681bf3f67910"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:40:23.655723 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.655695 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "17caf053-4398-4152-9474-681bf3f67910" (UID: "17caf053-4398-4152-9474-681bf3f67910"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:40:23.656052 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.656021 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-istio-token" (OuterVolumeSpecName: "istio-token") pod "17caf053-4398-4152-9474-681bf3f67910" (UID: "17caf053-4398-4152-9474-681bf3f67910"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:40:23.656144 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.656070 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-cacerts" (OuterVolumeSpecName: "cacerts") pod "17caf053-4398-4152-9474-681bf3f67910" (UID: "17caf053-4398-4152-9474-681bf3f67910"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:40:23.656144 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.656085 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "17caf053-4398-4152-9474-681bf3f67910" (UID: "17caf053-4398-4152-9474-681bf3f67910"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:40:23.656233 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.656139 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-kube-api-access-dldgl" (OuterVolumeSpecName: "kube-api-access-dldgl") pod "17caf053-4398-4152-9474-681bf3f67910" (UID: "17caf053-4398-4152-9474-681bf3f67910"). InnerVolumeSpecName "kube-api-access-dldgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:40:23.656268 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.656234 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17caf053-4398-4152-9474-681bf3f67910-local-certs" (OuterVolumeSpecName: "local-certs") pod "17caf053-4398-4152-9474-681bf3f67910" (UID: "17caf053-4398-4152-9474-681bf3f67910"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:40:23.754669 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.754627 2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-kubeconfig\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:40:23.754669 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.754660 2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-cacerts\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:40:23.754669 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.754674 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dldgl\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-kube-api-access-dldgl\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:40:23.754912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.754686 2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17caf053-4398-4152-9474-681bf3f67910-local-certs\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:40:23.754912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.754698 2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17caf053-4398-4152-9474-681bf3f67910-istio-csr-dns-cert\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:40:23.754912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.754709 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17caf053-4398-4152-9474-681bf3f67910-istio-token\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:40:23.754912 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:23.754720 2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17caf053-4398-4152-9474-681bf3f67910-istio-csr-ca-configmap\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:40:24.133293 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.133259 2560 generic.go:356] "Generic (PLEG): container finished" podID="17caf053-4398-4152-9474-681bf3f67910" containerID="fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461" exitCode=0 Jul 29 17:40:24.133500 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.133338 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" Jul 29 17:40:24.133500 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.133358 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" event={"ID":"17caf053-4398-4152-9474-681bf3f67910","Type":"ContainerDied","Data":"fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461"} Jul 29 17:40:24.133500 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.133426 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg" event={"ID":"17caf053-4398-4152-9474-681bf3f67910","Type":"ContainerDied","Data":"cecefb4e658fe8d2b7865a4597a12d58d08eda35a6076f90f0f0a4eca538b502"} Jul 29 17:40:24.133500 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.133447 2560 scope.go:117] "RemoveContainer" containerID="fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461" Jul 29 17:40:24.143046 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.143028 2560 scope.go:117] "RemoveContainer" containerID="fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461" Jul 29 17:40:24.143363 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:40:24.143345 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461\": container with ID starting with fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461 not found: ID does not exist" containerID="fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461" Jul 29 17:40:24.143419 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.143373 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461"} err="failed to get container status \"fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461\": rpc error: code = NotFound desc = could not find container \"fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461\": container with ID starting with fdeafcad4a2fd12f65468c3941345515ee414ae2bfce9e1e5f3bd94026fac461 not found: ID does not exist" Jul 29 17:40:24.155948 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.155919 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg"] Jul 29 17:40:24.160400 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.160368 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cbwkg"] Jul 29 17:40:24.489828 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:24.489755 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17caf053-4398-4152-9474-681bf3f67910" path="/var/lib/kubelet/pods/17caf053-4398-4152-9474-681bf3f67910/volumes" Jul 29 17:40:26.089364 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:26.089332 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2vw78" Jul 29 17:40:27.096184 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:27.096148 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rkv84" Jul 29 17:40:32.125128 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:40:32.125095 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-657444d86f-5fp9n" Jul 29 17:41:26.693898 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.693865 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn"] Jul 29 17:41:26.694357 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.694208 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17caf053-4398-4152-9474-681bf3f67910" containerName="discovery" Jul 29 17:41:26.694357 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.694218 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="17caf053-4398-4152-9474-681bf3f67910" containerName="discovery" Jul 29 17:41:26.694357 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.694285 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="17caf053-4398-4152-9474-681bf3f67910" containerName="discovery" Jul 29 17:41:26.696427 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.696411 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:26.698816 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.698791 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vxxdv\"" Jul 29 17:41:26.698937 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.698798 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 29 17:41:26.699168 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.699149 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 29 17:41:26.704910 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.704882 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn"] Jul 29 17:41:26.787233 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.787200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fc92\" (UniqueName: \"kubernetes.io/projected/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-kube-api-access-2fc92\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:26.787233 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.787235 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:26.787456 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.787319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:26.888163 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.888123 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:26.888397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.888213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fc92\" (UniqueName: \"kubernetes.io/projected/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-kube-api-access-2fc92\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:26.888397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.888234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:26.888606 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.888586 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:26.888693 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.888593 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:26.896299 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:26.896277 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fc92\" (UniqueName: \"kubernetes.io/projected/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-kube-api-access-2fc92\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:27.006126 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.006093 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:27.143827 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.143800 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn"] Jul 29 17:41:27.145907 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:41:27.145873 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324d1e40_f9a4_4fe5_be8f_5b1791b16ca7.slice/crio-d542a021cd3e4de765c44fb689eae41fc96292621c86d7d5624e6999457eed9d WatchSource:0}: Error finding container d542a021cd3e4de765c44fb689eae41fc96292621c86d7d5624e6999457eed9d: Status 404 returned error can't find the container with id d542a021cd3e4de765c44fb689eae41fc96292621c86d7d5624e6999457eed9d Jul 29 17:41:27.304037 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.303956 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6"] Jul 29 17:41:27.306160 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.306144 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.316872 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.316848 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6"] Jul 29 17:41:27.391907 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.391863 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.392101 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.391915 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.392101 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.391989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7597m\" (UniqueName: \"kubernetes.io/projected/afe6ceed-5181-4f35-b136-fd359cd752a3-kube-api-access-7597m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.467082 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.467044 2560 generic.go:356] "Generic (PLEG): container finished" podID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerID="9db418d1081d071d9cb932164337ca333ea083f5113091de2f992b574ee8417e" exitCode=0 Jul 29 17:41:27.467271 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.467135 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" event={"ID":"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7","Type":"ContainerDied","Data":"9db418d1081d071d9cb932164337ca333ea083f5113091de2f992b574ee8417e"} Jul 29 17:41:27.467271 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.467185 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" event={"ID":"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7","Type":"ContainerStarted","Data":"d542a021cd3e4de765c44fb689eae41fc96292621c86d7d5624e6999457eed9d"} Jul 29 17:41:27.492693 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.492665 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.492875 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.492708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7597m\" (UniqueName: \"kubernetes.io/projected/afe6ceed-5181-4f35-b136-fd359cd752a3-kube-api-access-7597m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.492875 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.492804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.493131 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.493112 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.493176 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.493126 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.500722 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.500684 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7597m\" (UniqueName: \"kubernetes.io/projected/afe6ceed-5181-4f35-b136-fd359cd752a3-kube-api-access-7597m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.615376 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.615262 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:27.753175 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.753144 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6"] Jul 29 17:41:27.756472 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:41:27.756448 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe6ceed_5181_4f35_b136_fd359cd752a3.slice/crio-26f55ee7c3df79d008e13b059137112a7afcbc4e040e8f60db9d3d3af90fdfbe WatchSource:0}: Error finding container 26f55ee7c3df79d008e13b059137112a7afcbc4e040e8f60db9d3d3af90fdfbe: Status 404 returned error can't find the container with id 26f55ee7c3df79d008e13b059137112a7afcbc4e040e8f60db9d3d3af90fdfbe Jul 29 17:41:27.897680 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.897597 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48"] Jul 29 17:41:27.899848 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.899829 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:27.911546 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.911518 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48"] Jul 29 17:41:27.996340 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.996284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:27.996541 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.996352 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:27.996541 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:27.996408 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgw7t\" (UniqueName: \"kubernetes.io/projected/e484a71b-c814-4b74-8841-9fedc46addbf-kube-api-access-kgw7t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:28.097682 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.097646 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:28.097887 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.097693 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:28.097887 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.097721 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgw7t\" (UniqueName: \"kubernetes.io/projected/e484a71b-c814-4b74-8841-9fedc46addbf-kube-api-access-kgw7t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:28.098044 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.098016 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:28.098122 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.098099 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:28.106838 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.106801 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgw7t\" (UniqueName: \"kubernetes.io/projected/e484a71b-c814-4b74-8841-9fedc46addbf-kube-api-access-kgw7t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:28.231021 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.230934 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:28.369991 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.369881 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48"] Jul 29 17:41:28.394215 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:41:28.394175 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode484a71b_c814_4b74_8841_9fedc46addbf.slice/crio-f5c672176d53332343fc38c28f1aae9b01854558982ac7089c9d70ef0cb98431 WatchSource:0}: Error finding container f5c672176d53332343fc38c28f1aae9b01854558982ac7089c9d70ef0cb98431: Status 404 returned error can't find the container with id f5c672176d53332343fc38c28f1aae9b01854558982ac7089c9d70ef0cb98431 Jul 29 17:41:28.474461 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.474424 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" event={"ID":"e484a71b-c814-4b74-8841-9fedc46addbf","Type":"ContainerStarted","Data":"d5d10381611405586cea4743d3f98ee2f9272ede640a632f5b3ed8e0d86e557d"} Jul 29 17:41:28.474605 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.474521 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" event={"ID":"e484a71b-c814-4b74-8841-9fedc46addbf","Type":"ContainerStarted","Data":"f5c672176d53332343fc38c28f1aae9b01854558982ac7089c9d70ef0cb98431"} Jul 29 17:41:28.476216 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.476192 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" event={"ID":"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7","Type":"ContainerStarted","Data":"6ef2fbee71b0d3c2e62e66462a3f2bcd389b001a46aae1817a3d0180681e7dcb"} Jul 29 17:41:28.478020 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.477992 2560 generic.go:356] "Generic (PLEG): container finished" podID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerID="5af7fe6fd361c49cf45c8c05549cac5c9528b72692c18b981e22ca275a9d325f" exitCode=0 Jul 29 17:41:28.478146 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.478069 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" event={"ID":"afe6ceed-5181-4f35-b136-fd359cd752a3","Type":"ContainerDied","Data":"5af7fe6fd361c49cf45c8c05549cac5c9528b72692c18b981e22ca275a9d325f"} Jul 29 17:41:28.478146 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.478134 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" event={"ID":"afe6ceed-5181-4f35-b136-fd359cd752a3","Type":"ContainerStarted","Data":"26f55ee7c3df79d008e13b059137112a7afcbc4e040e8f60db9d3d3af90fdfbe"} Jul 29 17:41:28.501163 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.501136 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8"] Jul 29 17:41:28.503692 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.503668 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.512553 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.512526 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8"] Jul 29 17:41:28.606164 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.606122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.606353 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.606174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6m9\" (UniqueName: \"kubernetes.io/projected/2e321436-958d-4b91-a458-464252be1279-kube-api-access-dr6m9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.606353 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.606228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.707330 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.707264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6m9\" (UniqueName: \"kubernetes.io/projected/2e321436-958d-4b91-a458-464252be1279-kube-api-access-dr6m9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.707533 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.707340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.707533 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.707409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.707739 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.707718 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.707786 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.707745 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.715397 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.715368 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6m9\" (UniqueName: \"kubernetes.io/projected/2e321436-958d-4b91-a458-464252be1279-kube-api-access-dr6m9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:28.911859 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:28.911775 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:29.052030 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:29.052002 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8"] Jul 29 17:41:29.054227 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:41:29.054189 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e321436_958d_4b91_a458_464252be1279.slice/crio-cab96ed15e564e6a8128fae14cf9d2295cc0ff8aa5509f7b8c5ac24d41e980f3 WatchSource:0}: Error finding container cab96ed15e564e6a8128fae14cf9d2295cc0ff8aa5509f7b8c5ac24d41e980f3: Status 404 returned error can't find the container with id cab96ed15e564e6a8128fae14cf9d2295cc0ff8aa5509f7b8c5ac24d41e980f3 Jul 29 17:41:29.484389 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:29.484355 2560 generic.go:356] "Generic (PLEG): container finished" podID="2e321436-958d-4b91-a458-464252be1279" containerID="e2b4c4374d5fc2994820cfa514eca06b005c747bc43ac86347f4a59e1ff91417" exitCode=0 Jul 29 17:41:29.484594 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:29.484446 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" event={"ID":"2e321436-958d-4b91-a458-464252be1279","Type":"ContainerDied","Data":"e2b4c4374d5fc2994820cfa514eca06b005c747bc43ac86347f4a59e1ff91417"} Jul 29 17:41:29.484594 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:29.484498 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" event={"ID":"2e321436-958d-4b91-a458-464252be1279","Type":"ContainerStarted","Data":"cab96ed15e564e6a8128fae14cf9d2295cc0ff8aa5509f7b8c5ac24d41e980f3"} Jul 29 17:41:29.486162 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:29.486134 2560 generic.go:356] "Generic (PLEG): container finished" podID="e484a71b-c814-4b74-8841-9fedc46addbf" containerID="d5d10381611405586cea4743d3f98ee2f9272ede640a632f5b3ed8e0d86e557d" exitCode=0 Jul 29 17:41:29.486293 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:29.486212 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" event={"ID":"e484a71b-c814-4b74-8841-9fedc46addbf","Type":"ContainerDied","Data":"d5d10381611405586cea4743d3f98ee2f9272ede640a632f5b3ed8e0d86e557d"} Jul 29 17:41:29.488299 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:29.488279 2560 generic.go:356] "Generic (PLEG): container finished" podID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerID="6ef2fbee71b0d3c2e62e66462a3f2bcd389b001a46aae1817a3d0180681e7dcb" exitCode=0 Jul 29 17:41:29.488438 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:29.488340 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" event={"ID":"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7","Type":"ContainerDied","Data":"6ef2fbee71b0d3c2e62e66462a3f2bcd389b001a46aae1817a3d0180681e7dcb"} Jul 29 17:41:30.495822 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:30.495794 2560 generic.go:356] "Generic (PLEG): container finished" podID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerID="effc044a1f798f09c3dea8fcae06f24177822c3fd75bc14dc08084b109d828be" exitCode=0 Jul 29 17:41:30.496231 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:30.495858 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" event={"ID":"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7","Type":"ContainerDied","Data":"effc044a1f798f09c3dea8fcae06f24177822c3fd75bc14dc08084b109d828be"} Jul 29 17:41:30.498113 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:30.498087 2560 generic.go:356] "Generic (PLEG): container finished" podID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerID="17d99492446eeb8569279fa4ca5d21e0ca053ba24831312439102b55cea48ec7" exitCode=0 Jul 29 17:41:30.498252 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:30.498219 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" event={"ID":"afe6ceed-5181-4f35-b136-fd359cd752a3","Type":"ContainerDied","Data":"17d99492446eeb8569279fa4ca5d21e0ca053ba24831312439102b55cea48ec7"} Jul 29 17:41:30.500927 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:30.500899 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" event={"ID":"2e321436-958d-4b91-a458-464252be1279","Type":"ContainerStarted","Data":"c4359ab2a4d181a4f9db3c7a63713a251192ea39ad4fd3c9f7145d71e0c45caf"} Jul 29 17:41:31.507559 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.507522 2560 generic.go:356] "Generic (PLEG): container finished" podID="2e321436-958d-4b91-a458-464252be1279" containerID="c4359ab2a4d181a4f9db3c7a63713a251192ea39ad4fd3c9f7145d71e0c45caf" exitCode=0 Jul 29 17:41:31.508042 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.507607 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" event={"ID":"2e321436-958d-4b91-a458-464252be1279","Type":"ContainerDied","Data":"c4359ab2a4d181a4f9db3c7a63713a251192ea39ad4fd3c9f7145d71e0c45caf"} Jul 29 17:41:31.509526 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.509502 2560 generic.go:356] "Generic (PLEG): container finished" podID="e484a71b-c814-4b74-8841-9fedc46addbf" containerID="54f2b97100a375f9890aaf6129ee0675c732e23316577bb80708ef5b8ce8525a" exitCode=0 Jul 29 17:41:31.509641 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.509626 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" event={"ID":"e484a71b-c814-4b74-8841-9fedc46addbf","Type":"ContainerDied","Data":"54f2b97100a375f9890aaf6129ee0675c732e23316577bb80708ef5b8ce8525a"} Jul 29 17:41:31.511935 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.511909 2560 generic.go:356] "Generic (PLEG): container finished" podID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerID="8f8bc65793a054f471794caf894ff7f8a9f9cbe257847fce1e812e1183c9366d" exitCode=0 Jul 29 17:41:31.512015 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.511983 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" event={"ID":"afe6ceed-5181-4f35-b136-fd359cd752a3","Type":"ContainerDied","Data":"8f8bc65793a054f471794caf894ff7f8a9f9cbe257847fce1e812e1183c9366d"} Jul 29 17:41:31.667846 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.667816 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:31.736006 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.735975 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-util\") pod \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " Jul 29 17:41:31.736218 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.736055 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fc92\" (UniqueName: \"kubernetes.io/projected/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-kube-api-access-2fc92\") pod \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " Jul 29 17:41:31.736218 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.736109 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-bundle\") pod \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\" (UID: \"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7\") " Jul 29 17:41:31.736609 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.736579 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-bundle" (OuterVolumeSpecName: "bundle") pod "324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" (UID: "324d1e40-f9a4-4fe5-be8f-5b1791b16ca7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:41:31.738551 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.738520 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-kube-api-access-2fc92" (OuterVolumeSpecName: "kube-api-access-2fc92") pod "324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" (UID: "324d1e40-f9a4-4fe5-be8f-5b1791b16ca7"). InnerVolumeSpecName "kube-api-access-2fc92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:41:31.741866 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.741843 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-util" (OuterVolumeSpecName: "util") pod "324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" (UID: "324d1e40-f9a4-4fe5-be8f-5b1791b16ca7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:41:31.837780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.837683 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fc92\" (UniqueName: \"kubernetes.io/projected/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-kube-api-access-2fc92\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:31.837780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.837721 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:31.837780 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:31.837733 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/324d1e40-f9a4-4fe5-be8f-5b1791b16ca7-util\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:32.518601 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.518564 2560 generic.go:356] "Generic (PLEG): container finished" podID="e484a71b-c814-4b74-8841-9fedc46addbf" containerID="0e6a01b1a59414cd5b39b560ff5886429a4546301a503ff51cc0bd66c56a8d73" exitCode=0 Jul 29 17:41:32.519043 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.518634 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" event={"ID":"e484a71b-c814-4b74-8841-9fedc46addbf","Type":"ContainerDied","Data":"0e6a01b1a59414cd5b39b560ff5886429a4546301a503ff51cc0bd66c56a8d73"} Jul 29 17:41:32.520505 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.520486 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" Jul 29 17:41:32.520644 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.520514 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn" event={"ID":"324d1e40-f9a4-4fe5-be8f-5b1791b16ca7","Type":"ContainerDied","Data":"d542a021cd3e4de765c44fb689eae41fc96292621c86d7d5624e6999457eed9d"} Jul 29 17:41:32.520644 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.520550 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d542a021cd3e4de765c44fb689eae41fc96292621c86d7d5624e6999457eed9d" Jul 29 17:41:32.523049 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.523024 2560 generic.go:356] "Generic (PLEG): container finished" podID="2e321436-958d-4b91-a458-464252be1279" containerID="f1d150548f60fdb951aa14313eebf8b39cbc489d7ab2e395712033ff2d3e4903" exitCode=0 Jul 29 17:41:32.523140 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.523080 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" event={"ID":"2e321436-958d-4b91-a458-464252be1279","Type":"ContainerDied","Data":"f1d150548f60fdb951aa14313eebf8b39cbc489d7ab2e395712033ff2d3e4903"} Jul 29 17:41:32.660637 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.660610 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:32.746823 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.746791 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-util\") pod \"afe6ceed-5181-4f35-b136-fd359cd752a3\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " Jul 29 17:41:32.746965 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.746870 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7597m\" (UniqueName: \"kubernetes.io/projected/afe6ceed-5181-4f35-b136-fd359cd752a3-kube-api-access-7597m\") pod \"afe6ceed-5181-4f35-b136-fd359cd752a3\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " Jul 29 17:41:32.746965 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.746922 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-bundle\") pod \"afe6ceed-5181-4f35-b136-fd359cd752a3\" (UID: \"afe6ceed-5181-4f35-b136-fd359cd752a3\") " Jul 29 17:41:32.747579 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.747551 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-bundle" (OuterVolumeSpecName: "bundle") pod "afe6ceed-5181-4f35-b136-fd359cd752a3" (UID: "afe6ceed-5181-4f35-b136-fd359cd752a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:41:32.749115 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.749084 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afe6ceed-5181-4f35-b136-fd359cd752a3-kube-api-access-7597m" (OuterVolumeSpecName: "kube-api-access-7597m") pod "afe6ceed-5181-4f35-b136-fd359cd752a3" (UID: "afe6ceed-5181-4f35-b136-fd359cd752a3"). InnerVolumeSpecName "kube-api-access-7597m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:41:32.752384 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.752288 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-util" (OuterVolumeSpecName: "util") pod "afe6ceed-5181-4f35-b136-fd359cd752a3" (UID: "afe6ceed-5181-4f35-b136-fd359cd752a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:41:32.847482 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.847445 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-util\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:32.847482 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.847477 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7597m\" (UniqueName: \"kubernetes.io/projected/afe6ceed-5181-4f35-b136-fd359cd752a3-kube-api-access-7597m\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:32.847482 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:32.847489 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe6ceed-5181-4f35-b136-fd359cd752a3-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:33.529817 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.529786 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" Jul 29 17:41:33.529817 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.529790 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6" event={"ID":"afe6ceed-5181-4f35-b136-fd359cd752a3","Type":"ContainerDied","Data":"26f55ee7c3df79d008e13b059137112a7afcbc4e040e8f60db9d3d3af90fdfbe"} Jul 29 17:41:33.530261 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.529840 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26f55ee7c3df79d008e13b059137112a7afcbc4e040e8f60db9d3d3af90fdfbe" Jul 29 17:41:33.690813 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.690792 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:33.692823 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.692807 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:33.754642 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.754608 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgw7t\" (UniqueName: \"kubernetes.io/projected/e484a71b-c814-4b74-8841-9fedc46addbf-kube-api-access-kgw7t\") pod \"e484a71b-c814-4b74-8841-9fedc46addbf\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " Jul 29 17:41:33.754642 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.754644 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr6m9\" (UniqueName: \"kubernetes.io/projected/2e321436-958d-4b91-a458-464252be1279-kube-api-access-dr6m9\") pod \"2e321436-958d-4b91-a458-464252be1279\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " Jul 29 17:41:33.754869 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.754684 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-util\") pod \"e484a71b-c814-4b74-8841-9fedc46addbf\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " Jul 29 17:41:33.754869 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.754713 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-bundle\") pod \"2e321436-958d-4b91-a458-464252be1279\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " Jul 29 17:41:33.754869 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.754820 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-util\") pod \"2e321436-958d-4b91-a458-464252be1279\" (UID: \"2e321436-958d-4b91-a458-464252be1279\") " Jul 29 17:41:33.754869 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.754850 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-bundle\") pod \"e484a71b-c814-4b74-8841-9fedc46addbf\" (UID: \"e484a71b-c814-4b74-8841-9fedc46addbf\") " Jul 29 17:41:33.755390 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.755299 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-bundle" (OuterVolumeSpecName: "bundle") pod "2e321436-958d-4b91-a458-464252be1279" (UID: "2e321436-958d-4b91-a458-464252be1279"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:41:33.755783 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.755749 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-bundle" (OuterVolumeSpecName: "bundle") pod "e484a71b-c814-4b74-8841-9fedc46addbf" (UID: "e484a71b-c814-4b74-8841-9fedc46addbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:41:33.756964 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.756940 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e321436-958d-4b91-a458-464252be1279-kube-api-access-dr6m9" (OuterVolumeSpecName: "kube-api-access-dr6m9") pod "2e321436-958d-4b91-a458-464252be1279" (UID: "2e321436-958d-4b91-a458-464252be1279"). InnerVolumeSpecName "kube-api-access-dr6m9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:41:33.757071 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.756958 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e484a71b-c814-4b74-8841-9fedc46addbf-kube-api-access-kgw7t" (OuterVolumeSpecName: "kube-api-access-kgw7t") pod "e484a71b-c814-4b74-8841-9fedc46addbf" (UID: "e484a71b-c814-4b74-8841-9fedc46addbf"). InnerVolumeSpecName "kube-api-access-kgw7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:41:33.763455 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.763419 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-util" (OuterVolumeSpecName: "util") pod "e484a71b-c814-4b74-8841-9fedc46addbf" (UID: "e484a71b-c814-4b74-8841-9fedc46addbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:41:33.763721 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.763698 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-util" (OuterVolumeSpecName: "util") pod "2e321436-958d-4b91-a458-464252be1279" (UID: "2e321436-958d-4b91-a458-464252be1279"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 17:41:33.855864 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.855772 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-util\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:33.855864 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.855806 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:33.855864 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.855817 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgw7t\" (UniqueName: \"kubernetes.io/projected/e484a71b-c814-4b74-8841-9fedc46addbf-kube-api-access-kgw7t\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:33.855864 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.855826 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr6m9\" (UniqueName: \"kubernetes.io/projected/2e321436-958d-4b91-a458-464252be1279-kube-api-access-dr6m9\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:33.855864 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.855836 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e484a71b-c814-4b74-8841-9fedc46addbf-util\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:33.855864 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:33.855844 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e321436-958d-4b91-a458-464252be1279-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:41:34.536762 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:34.536733 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" Jul 29 17:41:34.537208 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:34.536735 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8" event={"ID":"2e321436-958d-4b91-a458-464252be1279","Type":"ContainerDied","Data":"cab96ed15e564e6a8128fae14cf9d2295cc0ff8aa5509f7b8c5ac24d41e980f3"} Jul 29 17:41:34.537208 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:34.536848 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cab96ed15e564e6a8128fae14cf9d2295cc0ff8aa5509f7b8c5ac24d41e980f3" Jul 29 17:41:34.538858 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:34.538790 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" Jul 29 17:41:34.538977 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:34.538824 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48" event={"ID":"e484a71b-c814-4b74-8841-9fedc46addbf","Type":"ContainerDied","Data":"f5c672176d53332343fc38c28f1aae9b01854558982ac7089c9d70ef0cb98431"} Jul 29 17:41:34.539061 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:34.539011 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5c672176d53332343fc38c28f1aae9b01854558982ac7089c9d70ef0cb98431" Jul 29 17:41:34.984013 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:41:34.983928 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79fc7f45d8-c9wwn"] Jul 29 17:42:00.006573 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.006490 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79fc7f45d8-c9wwn" podUID="ff3a8a78-9c1e-4728-8457-1015047b995e" containerName="console" containerID="cri-o://4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615" gracePeriod=15 Jul 29 17:42:00.263394 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.263331 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:42:00.388955 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.388904 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-console-config\") pod \"ff3a8a78-9c1e-4728-8457-1015047b995e\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " Jul 29 17:42:00.388955 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.388958 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-oauth-serving-cert\") pod \"ff3a8a78-9c1e-4728-8457-1015047b995e\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " Jul 29 17:42:00.389221 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389037 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-serving-cert\") pod \"ff3a8a78-9c1e-4728-8457-1015047b995e\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " Jul 29 17:42:00.389221 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389068 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-trusted-ca-bundle\") pod \"ff3a8a78-9c1e-4728-8457-1015047b995e\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " Jul 29 17:42:00.389221 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389113 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-oauth-config\") pod \"ff3a8a78-9c1e-4728-8457-1015047b995e\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " Jul 29 17:42:00.389221 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389149 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmn9h\" (UniqueName: \"kubernetes.io/projected/ff3a8a78-9c1e-4728-8457-1015047b995e-kube-api-access-pmn9h\") pod \"ff3a8a78-9c1e-4728-8457-1015047b995e\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " Jul 29 17:42:00.389221 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389186 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-service-ca\") pod \"ff3a8a78-9c1e-4728-8457-1015047b995e\" (UID: \"ff3a8a78-9c1e-4728-8457-1015047b995e\") " Jul 29 17:42:00.389517 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389371 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-console-config" (OuterVolumeSpecName: "console-config") pod "ff3a8a78-9c1e-4728-8457-1015047b995e" (UID: "ff3a8a78-9c1e-4728-8457-1015047b995e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:42:00.389575 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389421 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff3a8a78-9c1e-4728-8457-1015047b995e" (UID: "ff3a8a78-9c1e-4728-8457-1015047b995e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:42:00.389636 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389578 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-console-config\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:42:00.389636 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389619 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ff3a8a78-9c1e-4728-8457-1015047b995e" (UID: "ff3a8a78-9c1e-4728-8457-1015047b995e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:42:00.389739 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.389704 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff3a8a78-9c1e-4728-8457-1015047b995e" (UID: "ff3a8a78-9c1e-4728-8457-1015047b995e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 17:42:00.391578 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.391548 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff3a8a78-9c1e-4728-8457-1015047b995e" (UID: "ff3a8a78-9c1e-4728-8457-1015047b995e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:42:00.391699 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.391587 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3a8a78-9c1e-4728-8457-1015047b995e-kube-api-access-pmn9h" (OuterVolumeSpecName: "kube-api-access-pmn9h") pod "ff3a8a78-9c1e-4728-8457-1015047b995e" (UID: "ff3a8a78-9c1e-4728-8457-1015047b995e"). InnerVolumeSpecName "kube-api-access-pmn9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:42:00.391699 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.391594 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff3a8a78-9c1e-4728-8457-1015047b995e" (UID: "ff3a8a78-9c1e-4728-8457-1015047b995e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:42:00.490546 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.490514 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-service-ca\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:42:00.490546 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.490537 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-oauth-serving-cert\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:42:00.490546 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.490550 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-serving-cert\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:42:00.490822 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.490564 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3a8a78-9c1e-4728-8457-1015047b995e-trusted-ca-bundle\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:42:00.490822 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.490573 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff3a8a78-9c1e-4728-8457-1015047b995e-console-oauth-config\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:42:00.490822 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.490580 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmn9h\" (UniqueName: \"kubernetes.io/projected/ff3a8a78-9c1e-4728-8457-1015047b995e-kube-api-access-pmn9h\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:42:00.501025 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.500997 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x"] Jul 29 17:42:00.501329 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501299 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerName="pull" Jul 29 17:42:00.501377 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501331 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerName="pull" Jul 29 17:42:00.501377 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501340 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e321436-958d-4b91-a458-464252be1279" containerName="util" Jul 29 17:42:00.501377 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501346 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e321436-958d-4b91-a458-464252be1279" containerName="util" Jul 29 17:42:00.501377 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501354 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerName="extract" Jul 29 17:42:00.501377 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501359 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerName="extract" Jul 29 17:42:00.501377 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501366 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3a8a78-9c1e-4728-8457-1015047b995e" containerName="console" Jul 29 17:42:00.501377 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501371 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3a8a78-9c1e-4728-8457-1015047b995e" containerName="console" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501381 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e484a71b-c814-4b74-8841-9fedc46addbf" containerName="extract" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501386 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e484a71b-c814-4b74-8841-9fedc46addbf" containerName="extract" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501397 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerName="pull" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501402 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerName="pull" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501409 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e321436-958d-4b91-a458-464252be1279" containerName="extract" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501413 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e321436-958d-4b91-a458-464252be1279" containerName="extract" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501420 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerName="util" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501425 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerName="util" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501432 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerName="util" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501437 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerName="util" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501443 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e484a71b-c814-4b74-8841-9fedc46addbf" containerName="util" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501448 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e484a71b-c814-4b74-8841-9fedc46addbf" containerName="util" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501453 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e321436-958d-4b91-a458-464252be1279" containerName="pull" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501458 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e321436-958d-4b91-a458-464252be1279" containerName="pull" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501462 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e484a71b-c814-4b74-8841-9fedc46addbf" containerName="pull" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501467 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e484a71b-c814-4b74-8841-9fedc46addbf" containerName="pull" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501474 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerName="extract" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501478 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerName="extract" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501529 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e484a71b-c814-4b74-8841-9fedc46addbf" containerName="extract" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501536 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe6ceed-5181-4f35-b136-fd359cd752a3" containerName="extract" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501543 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="324d1e40-f9a4-4fe5-be8f-5b1791b16ca7" containerName="extract" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501548 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3a8a78-9c1e-4728-8457-1015047b995e" containerName="console" Jul 29 17:42:00.501577 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.501554 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e321436-958d-4b91-a458-464252be1279" containerName="extract" Jul 29 17:42:00.504640 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.504619 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.506817 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.506789 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 29 17:42:00.506937 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.506843 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vxxdv\"" Jul 29 17:42:00.506937 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.506927 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 29 17:42:00.507125 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.507110 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 29 17:42:00.507125 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.507121 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 29 17:42:00.515646 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.515584 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x"] Jul 29 17:42:00.591673 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.591630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drf2h\" (UniqueName: \"kubernetes.io/projected/65afafa4-7e19-42be-876d-baafc290b568-kube-api-access-drf2h\") pod \"kuadrant-console-plugin-66b5774985-vwn5x\" (UID: \"65afafa4-7e19-42be-876d-baafc290b568\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.591869 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.591719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/65afafa4-7e19-42be-876d-baafc290b568-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vwn5x\" (UID: \"65afafa4-7e19-42be-876d-baafc290b568\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.591869 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.591754 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/65afafa4-7e19-42be-876d-baafc290b568-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vwn5x\" (UID: \"65afafa4-7e19-42be-876d-baafc290b568\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.668050 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.668012 2560 generic.go:356] "Generic (PLEG): container finished" podID="ff3a8a78-9c1e-4728-8457-1015047b995e" containerID="4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615" exitCode=0 Jul 29 17:42:00.668238 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.668070 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79fc7f45d8-c9wwn" Jul 29 17:42:00.668238 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.668095 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79fc7f45d8-c9wwn" event={"ID":"ff3a8a78-9c1e-4728-8457-1015047b995e","Type":"ContainerDied","Data":"4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615"} Jul 29 17:42:00.668238 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.668151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79fc7f45d8-c9wwn" event={"ID":"ff3a8a78-9c1e-4728-8457-1015047b995e","Type":"ContainerDied","Data":"999f5d53c9955f44a4bff0871065c1ba12b00798e65b7410cf50f5098dda1fa4"} Jul 29 17:42:00.668238 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.668176 2560 scope.go:117] "RemoveContainer" containerID="4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615" Jul 29 17:42:00.677837 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.677814 2560 scope.go:117] "RemoveContainer" containerID="4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615" Jul 29 17:42:00.678146 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:42:00.678130 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615\": container with ID starting with 4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615 not found: ID does not exist" containerID="4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615" Jul 29 17:42:00.678215 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.678156 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615"} err="failed to get container status \"4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615\": rpc error: code = NotFound desc = could not find container \"4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615\": container with ID starting with 4359c99510e0e14acae063226c7bdbe3648c137fe78fb02fcc73d92620794615 not found: ID does not exist" Jul 29 17:42:00.685671 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.685646 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79fc7f45d8-c9wwn"] Jul 29 17:42:00.691488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.691463 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79fc7f45d8-c9wwn"] Jul 29 17:42:00.692411 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.692390 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/65afafa4-7e19-42be-876d-baafc290b568-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vwn5x\" (UID: \"65afafa4-7e19-42be-876d-baafc290b568\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.692516 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.692434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/65afafa4-7e19-42be-876d-baafc290b568-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vwn5x\" (UID: \"65afafa4-7e19-42be-876d-baafc290b568\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.692516 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.692493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drf2h\" (UniqueName: \"kubernetes.io/projected/65afafa4-7e19-42be-876d-baafc290b568-kube-api-access-drf2h\") pod \"kuadrant-console-plugin-66b5774985-vwn5x\" (UID: \"65afafa4-7e19-42be-876d-baafc290b568\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.693105 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.693088 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/65afafa4-7e19-42be-876d-baafc290b568-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vwn5x\" (UID: \"65afafa4-7e19-42be-876d-baafc290b568\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.695013 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.694995 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/65afafa4-7e19-42be-876d-baafc290b568-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vwn5x\" (UID: \"65afafa4-7e19-42be-876d-baafc290b568\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.700363 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.700341 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drf2h\" (UniqueName: \"kubernetes.io/projected/65afafa4-7e19-42be-876d-baafc290b568-kube-api-access-drf2h\") pod \"kuadrant-console-plugin-66b5774985-vwn5x\" (UID: \"65afafa4-7e19-42be-876d-baafc290b568\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.815901 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.815806 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" Jul 29 17:42:00.956617 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:00.956589 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x"] Jul 29 17:42:00.958769 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:42:00.958742 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65afafa4_7e19_42be_876d_baafc290b568.slice/crio-ba12e496aa3ee3969eb1afcfdc2e4c5dc90bb4170ae13da892cf62c3b78719d5 WatchSource:0}: Error finding container ba12e496aa3ee3969eb1afcfdc2e4c5dc90bb4170ae13da892cf62c3b78719d5: Status 404 returned error can't find the container with id ba12e496aa3ee3969eb1afcfdc2e4c5dc90bb4170ae13da892cf62c3b78719d5 Jul 29 17:42:01.673926 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:01.673890 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" event={"ID":"65afafa4-7e19-42be-876d-baafc290b568","Type":"ContainerStarted","Data":"ba12e496aa3ee3969eb1afcfdc2e4c5dc90bb4170ae13da892cf62c3b78719d5"} Jul 29 17:42:02.493591 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:02.493556 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3a8a78-9c1e-4728-8457-1015047b995e" path="/var/lib/kubelet/pods/ff3a8a78-9c1e-4728-8457-1015047b995e/volumes" Jul 29 17:42:25.825276 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:25.825237 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" event={"ID":"65afafa4-7e19-42be-876d-baafc290b568","Type":"ContainerStarted","Data":"1eef8bafa68c971c452aaffa3ea4e095bb41ad794c3b38baf2d65af9c5a6e3bb"} Jul 29 17:42:25.843089 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:25.843038 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vwn5x" podStartSLOduration=1.9490862610000002 podStartE2EDuration="25.843022064s" totalImagesPullingTime="23.893935803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:42:25.841920184 +0000 UTC m=+473.882805465" watchObservedRunningTime="2026-07-29 17:42:25.843022064 +0000 UTC m=+473.883907353" Jul 29 17:42:59.223182 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.223148 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq55"] Jul 29 17:42:59.225532 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.225514 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7cq55" Jul 29 17:42:59.227632 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.227608 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r6spp\"" Jul 29 17:42:59.231375 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.231352 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq55"] Jul 29 17:42:59.315427 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.315391 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86mbv\" (UniqueName: \"kubernetes.io/projected/a5473834-80fe-424d-93e5-091e78d04188-kube-api-access-86mbv\") pod \"authorino-58cd955675-7cq55\" (UID: \"a5473834-80fe-424d-93e5-091e78d04188\") " pod="kuadrant-system/authorino-58cd955675-7cq55" Jul 29 17:42:59.416202 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.416161 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86mbv\" (UniqueName: \"kubernetes.io/projected/a5473834-80fe-424d-93e5-091e78d04188-kube-api-access-86mbv\") pod \"authorino-58cd955675-7cq55\" (UID: \"a5473834-80fe-424d-93e5-091e78d04188\") " pod="kuadrant-system/authorino-58cd955675-7cq55" Jul 29 17:42:59.421626 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.421598 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2cc69"] Jul 29 17:42:59.423778 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.423748 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86mbv\" (UniqueName: \"kubernetes.io/projected/a5473834-80fe-424d-93e5-091e78d04188-kube-api-access-86mbv\") pod \"authorino-58cd955675-7cq55\" (UID: \"a5473834-80fe-424d-93e5-091e78d04188\") " pod="kuadrant-system/authorino-58cd955675-7cq55" Jul 29 17:42:59.424258 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.424241 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2cc69" Jul 29 17:42:59.431286 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.431259 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2cc69"] Jul 29 17:42:59.517164 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.517127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m5qc\" (UniqueName: \"kubernetes.io/projected/43f9d30e-28db-4945-98df-062e51995285-kube-api-access-6m5qc\") pod \"authorino-75d556bd77-2cc69\" (UID: \"43f9d30e-28db-4945-98df-062e51995285\") " pod="kuadrant-system/authorino-75d556bd77-2cc69" Jul 29 17:42:59.535773 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.535746 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7cq55" Jul 29 17:42:59.617765 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.617722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m5qc\" (UniqueName: \"kubernetes.io/projected/43f9d30e-28db-4945-98df-062e51995285-kube-api-access-6m5qc\") pod \"authorino-75d556bd77-2cc69\" (UID: \"43f9d30e-28db-4945-98df-062e51995285\") " pod="kuadrant-system/authorino-75d556bd77-2cc69" Jul 29 17:42:59.626889 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.626854 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m5qc\" (UniqueName: \"kubernetes.io/projected/43f9d30e-28db-4945-98df-062e51995285-kube-api-access-6m5qc\") pod \"authorino-75d556bd77-2cc69\" (UID: \"43f9d30e-28db-4945-98df-062e51995285\") " pod="kuadrant-system/authorino-75d556bd77-2cc69" Jul 29 17:42:59.672750 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.672722 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq55"] Jul 29 17:42:59.742154 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.742121 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2cc69" Jul 29 17:42:59.881203 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.881168 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2cc69"] Jul 29 17:42:59.883180 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:42:59.883155 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43f9d30e_28db_4945_98df_062e51995285.slice/crio-bcc53e3b0d665570ddfbaf6aff12c5d788cf86e6b2f4914ee170a3da829b64d0 WatchSource:0}: Error finding container bcc53e3b0d665570ddfbaf6aff12c5d788cf86e6b2f4914ee170a3da829b64d0: Status 404 returned error can't find the container with id bcc53e3b0d665570ddfbaf6aff12c5d788cf86e6b2f4914ee170a3da829b64d0 Jul 29 17:42:59.992509 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.992468 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2cc69" event={"ID":"43f9d30e-28db-4945-98df-062e51995285","Type":"ContainerStarted","Data":"bcc53e3b0d665570ddfbaf6aff12c5d788cf86e6b2f4914ee170a3da829b64d0"} Jul 29 17:42:59.993643 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:42:59.993619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7cq55" event={"ID":"a5473834-80fe-424d-93e5-091e78d04188","Type":"ContainerStarted","Data":"82bb1ff227002fbf96e4d277e4b19723f5876f0f2fdb42642b5efb4907ac3cb0"} Jul 29 17:43:04.020120 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:04.020085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2cc69" event={"ID":"43f9d30e-28db-4945-98df-062e51995285","Type":"ContainerStarted","Data":"c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e"} Jul 29 17:43:04.021749 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:04.021724 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7cq55" event={"ID":"a5473834-80fe-424d-93e5-091e78d04188","Type":"ContainerStarted","Data":"42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee"} Jul 29 17:43:04.037628 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:04.037571 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2cc69" podStartSLOduration=1.5793709470000001 podStartE2EDuration="5.037551057s" totalImagesPullingTime="3.45818011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:43:04.034821045 +0000 UTC m=+512.075706335" watchObservedRunningTime="2026-07-29 17:43:04.037551057 +0000 UTC m=+512.078436349" Jul 29 17:43:04.049034 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:04.048956 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7cq55" podStartSLOduration=1.371568301 podStartE2EDuration="5.048939193s" totalImagesPullingTime="3.677370892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:43:04.048414084 +0000 UTC m=+512.089299374" watchObservedRunningTime="2026-07-29 17:43:04.048939193 +0000 UTC m=+512.089824483" Jul 29 17:43:04.078086 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:04.078051 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq55"] Jul 29 17:43:06.032742 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:06.032698 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7cq55" podUID="a5473834-80fe-424d-93e5-091e78d04188" containerName="authorino" containerID="cri-o://42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee" gracePeriod=30 Jul 29 17:43:06.292117 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:06.292056 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7cq55" Jul 29 17:43:06.379562 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:06.379520 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86mbv\" (UniqueName: \"kubernetes.io/projected/a5473834-80fe-424d-93e5-091e78d04188-kube-api-access-86mbv\") pod \"a5473834-80fe-424d-93e5-091e78d04188\" (UID: \"a5473834-80fe-424d-93e5-091e78d04188\") " Jul 29 17:43:06.381756 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:06.381730 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5473834-80fe-424d-93e5-091e78d04188-kube-api-access-86mbv" (OuterVolumeSpecName: "kube-api-access-86mbv") pod "a5473834-80fe-424d-93e5-091e78d04188" (UID: "a5473834-80fe-424d-93e5-091e78d04188"). InnerVolumeSpecName "kube-api-access-86mbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:43:06.480354 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:06.480283 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86mbv\" (UniqueName: \"kubernetes.io/projected/a5473834-80fe-424d-93e5-091e78d04188-kube-api-access-86mbv\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:43:07.039917 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:07.039875 2560 generic.go:356] "Generic (PLEG): container finished" podID="a5473834-80fe-424d-93e5-091e78d04188" containerID="42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee" exitCode=0 Jul 29 17:43:07.039917 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:07.039921 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7cq55" Jul 29 17:43:07.040426 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:07.039945 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7cq55" event={"ID":"a5473834-80fe-424d-93e5-091e78d04188","Type":"ContainerDied","Data":"42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee"} Jul 29 17:43:07.040426 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:07.039979 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7cq55" event={"ID":"a5473834-80fe-424d-93e5-091e78d04188","Type":"ContainerDied","Data":"82bb1ff227002fbf96e4d277e4b19723f5876f0f2fdb42642b5efb4907ac3cb0"} Jul 29 17:43:07.040426 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:07.039997 2560 scope.go:117] "RemoveContainer" containerID="42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee" Jul 29 17:43:07.049101 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:07.049082 2560 scope.go:117] "RemoveContainer" containerID="42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee" Jul 29 17:43:07.049421 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:43:07.049402 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee\": container with ID starting with 42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee not found: ID does not exist" containerID="42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee" Jul 29 17:43:07.049487 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:07.049435 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee"} err="failed to get container status \"42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee\": rpc error: code = NotFound desc = could not find container \"42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee\": container with ID starting with 42006bbf1d30ef31d4f260ec9a5b593f4c253319a6f386cbe69fb7f1742603ee not found: ID does not exist" Jul 29 17:43:07.055148 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:07.055117 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq55"] Jul 29 17:43:07.058161 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:07.058130 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq55"] Jul 29 17:43:08.490423 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:08.490392 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5473834-80fe-424d-93e5-091e78d04188" path="/var/lib/kubelet/pods/a5473834-80fe-424d-93e5-091e78d04188/volumes" Jul 29 17:43:32.825572 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:32.825536 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84cf997745-wwzk8"] Jul 29 17:43:32.825979 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:32.825857 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5473834-80fe-424d-93e5-091e78d04188" containerName="authorino" Jul 29 17:43:32.825979 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:32.825867 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5473834-80fe-424d-93e5-091e78d04188" containerName="authorino" Jul 29 17:43:32.825979 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:32.825934 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5473834-80fe-424d-93e5-091e78d04188" containerName="authorino" Jul 29 17:43:32.830410 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:32.830389 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84cf997745-wwzk8" Jul 29 17:43:32.837834 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:32.837809 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84cf997745-wwzk8"] Jul 29 17:43:32.911102 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:32.911059 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntrpk\" (UniqueName: \"kubernetes.io/projected/26551b4e-036a-4384-b8fe-c38e378b3fd2-kube-api-access-ntrpk\") pod \"authorino-84cf997745-wwzk8\" (UID: \"26551b4e-036a-4384-b8fe-c38e378b3fd2\") " pod="kuadrant-system/authorino-84cf997745-wwzk8" Jul 29 17:43:33.005380 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.005341 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84cf997745-wwzk8"] Jul 29 17:43:33.005611 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:43:33.005589 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ntrpk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-84cf997745-wwzk8" podUID="26551b4e-036a-4384-b8fe-c38e378b3fd2" Jul 29 17:43:33.012253 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.012215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntrpk\" (UniqueName: \"kubernetes.io/projected/26551b4e-036a-4384-b8fe-c38e378b3fd2-kube-api-access-ntrpk\") pod \"authorino-84cf997745-wwzk8\" (UID: \"26551b4e-036a-4384-b8fe-c38e378b3fd2\") " pod="kuadrant-system/authorino-84cf997745-wwzk8" Jul 29 17:43:33.022950 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.022911 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntrpk\" (UniqueName: \"kubernetes.io/projected/26551b4e-036a-4384-b8fe-c38e378b3fd2-kube-api-access-ntrpk\") pod \"authorino-84cf997745-wwzk8\" (UID: \"26551b4e-036a-4384-b8fe-c38e378b3fd2\") " pod="kuadrant-system/authorino-84cf997745-wwzk8" Jul 29 17:43:33.026696 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.026665 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5755596d77-c6t4s"] Jul 29 17:43:33.029979 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.029956 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:43:33.032074 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.032045 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 29 17:43:33.039497 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.039472 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5755596d77-c6t4s"] Jul 29 17:43:33.113667 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.113571 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-tls-cert\") pod \"authorino-5755596d77-c6t4s\" (UID: \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\") " pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:43:33.113667 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.113620 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5j5r\" (UniqueName: \"kubernetes.io/projected/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-kube-api-access-l5j5r\") pod \"authorino-5755596d77-c6t4s\" (UID: \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\") " pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:43:33.175386 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.175352 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84cf997745-wwzk8" Jul 29 17:43:33.182339 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.182293 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84cf997745-wwzk8" Jul 29 17:43:33.214141 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.214101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-tls-cert\") pod \"authorino-5755596d77-c6t4s\" (UID: \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\") " pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:43:33.214141 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.214145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5j5r\" (UniqueName: \"kubernetes.io/projected/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-kube-api-access-l5j5r\") pod \"authorino-5755596d77-c6t4s\" (UID: \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\") " pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:43:33.216824 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.216792 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-tls-cert\") pod \"authorino-5755596d77-c6t4s\" (UID: \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\") " pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:43:33.223758 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.223733 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5j5r\" (UniqueName: \"kubernetes.io/projected/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-kube-api-access-l5j5r\") pod \"authorino-5755596d77-c6t4s\" (UID: \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\") " pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:43:33.315358 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.315292 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntrpk\" (UniqueName: \"kubernetes.io/projected/26551b4e-036a-4384-b8fe-c38e378b3fd2-kube-api-access-ntrpk\") pod \"26551b4e-036a-4384-b8fe-c38e378b3fd2\" (UID: \"26551b4e-036a-4384-b8fe-c38e378b3fd2\") " Jul 29 17:43:33.317701 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.317667 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26551b4e-036a-4384-b8fe-c38e378b3fd2-kube-api-access-ntrpk" (OuterVolumeSpecName: "kube-api-access-ntrpk") pod "26551b4e-036a-4384-b8fe-c38e378b3fd2" (UID: "26551b4e-036a-4384-b8fe-c38e378b3fd2"). InnerVolumeSpecName "kube-api-access-ntrpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:43:33.340084 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.340037 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:43:33.416445 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.416402 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntrpk\" (UniqueName: \"kubernetes.io/projected/26551b4e-036a-4384-b8fe-c38e378b3fd2-kube-api-access-ntrpk\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:43:33.478462 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:33.478434 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5755596d77-c6t4s"] Jul 29 17:43:33.480926 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:43:33.480900 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87ca7a70_38d2_41fe_bfcd_9b118dd37c3c.slice/crio-c4c2064dae407482041e48fdfaa9ca898e124387e39e28e4191c12d62a94777a WatchSource:0}: Error finding container c4c2064dae407482041e48fdfaa9ca898e124387e39e28e4191c12d62a94777a: Status 404 returned error can't find the container with id c4c2064dae407482041e48fdfaa9ca898e124387e39e28e4191c12d62a94777a Jul 29 17:43:34.188058 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.187967 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84cf997745-wwzk8" Jul 29 17:43:34.188452 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.187960 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5755596d77-c6t4s" event={"ID":"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c","Type":"ContainerStarted","Data":"d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b"} Jul 29 17:43:34.188452 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.188150 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5755596d77-c6t4s" event={"ID":"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c","Type":"ContainerStarted","Data":"c4c2064dae407482041e48fdfaa9ca898e124387e39e28e4191c12d62a94777a"} Jul 29 17:43:34.204108 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.204047 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5755596d77-c6t4s" podStartSLOduration=0.883868268 podStartE2EDuration="1.204029927s" totalImagesPullingTime="320.161659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:43:34.202716204 +0000 UTC m=+542.243601495" watchObservedRunningTime="2026-07-29 17:43:34.204029927 +0000 UTC m=+542.244915270" Jul 29 17:43:34.227395 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.227365 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2cc69"] Jul 29 17:43:34.227636 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.227596 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2cc69" podUID="43f9d30e-28db-4945-98df-062e51995285" containerName="authorino" containerID="cri-o://c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e" gracePeriod=30 Jul 29 17:43:34.231679 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.231652 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84cf997745-wwzk8"] Jul 29 17:43:34.239280 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.239247 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84cf997745-wwzk8"] Jul 29 17:43:34.480327 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.480284 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2cc69" Jul 29 17:43:34.489679 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.489644 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26551b4e-036a-4384-b8fe-c38e378b3fd2" path="/var/lib/kubelet/pods/26551b4e-036a-4384-b8fe-c38e378b3fd2/volumes" Jul 29 17:43:34.627968 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.627932 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m5qc\" (UniqueName: \"kubernetes.io/projected/43f9d30e-28db-4945-98df-062e51995285-kube-api-access-6m5qc\") pod \"43f9d30e-28db-4945-98df-062e51995285\" (UID: \"43f9d30e-28db-4945-98df-062e51995285\") " Jul 29 17:43:34.630142 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.630114 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43f9d30e-28db-4945-98df-062e51995285-kube-api-access-6m5qc" (OuterVolumeSpecName: "kube-api-access-6m5qc") pod "43f9d30e-28db-4945-98df-062e51995285" (UID: "43f9d30e-28db-4945-98df-062e51995285"). InnerVolumeSpecName "kube-api-access-6m5qc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:43:34.729683 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:34.729594 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m5qc\" (UniqueName: \"kubernetes.io/projected/43f9d30e-28db-4945-98df-062e51995285-kube-api-access-6m5qc\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:43:35.195048 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:35.195009 2560 generic.go:356] "Generic (PLEG): container finished" podID="43f9d30e-28db-4945-98df-062e51995285" containerID="c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e" exitCode=0 Jul 29 17:43:35.195546 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:35.195105 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2cc69" Jul 29 17:43:35.195546 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:35.195130 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2cc69" event={"ID":"43f9d30e-28db-4945-98df-062e51995285","Type":"ContainerDied","Data":"c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e"} Jul 29 17:43:35.195546 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:35.195174 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2cc69" event={"ID":"43f9d30e-28db-4945-98df-062e51995285","Type":"ContainerDied","Data":"bcc53e3b0d665570ddfbaf6aff12c5d788cf86e6b2f4914ee170a3da829b64d0"} Jul 29 17:43:35.195546 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:35.195196 2560 scope.go:117] "RemoveContainer" containerID="c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e" Jul 29 17:43:35.204509 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:35.204486 2560 scope.go:117] "RemoveContainer" containerID="c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e" Jul 29 17:43:35.204826 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:43:35.204807 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e\": container with ID starting with c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e not found: ID does not exist" containerID="c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e" Jul 29 17:43:35.204900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:35.204835 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e"} err="failed to get container status \"c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e\": rpc error: code = NotFound desc = could not find container \"c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e\": container with ID starting with c359419750318a815a208fb428119d9b68408a667c0aee7c540568253ee8fb2e not found: ID does not exist" Jul 29 17:43:35.217108 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:35.217081 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2cc69"] Jul 29 17:43:35.220860 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:35.220838 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2cc69"] Jul 29 17:43:36.489966 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:43:36.489935 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43f9d30e-28db-4945-98df-062e51995285" path="/var/lib/kubelet/pods/43f9d30e-28db-4945-98df-062e51995285/volumes" Jul 29 17:44:32.386504 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:32.386473 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/1.log" Jul 29 17:44:32.395782 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:32.395753 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/1.log" Jul 29 17:44:52.537725 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.537690 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx"] Jul 29 17:44:52.539209 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.538168 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f9d30e-28db-4945-98df-062e51995285" containerName="authorino" Jul 29 17:44:52.539209 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.538186 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f9d30e-28db-4945-98df-062e51995285" containerName="authorino" Jul 29 17:44:52.539209 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.538262 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="43f9d30e-28db-4945-98df-062e51995285" containerName="authorino" Jul 29 17:44:52.539877 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.539861 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.542748 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.542722 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 29 17:44:52.542892 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.542764 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 29 17:44:52.542892 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.542781 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 29 17:44:52.542892 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.542722 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-psnzp\"" Jul 29 17:44:52.555771 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.555742 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx"] Jul 29 17:44:52.581369 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.581334 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhdxs\" (UniqueName: \"kubernetes.io/projected/2860a4ed-3407-43b4-9a60-6257a1b169ab-kube-api-access-nhdxs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.581543 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.581451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.581543 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.581469 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.581543 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.581488 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.581543 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.581507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.581715 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.581690 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2860a4ed-3407-43b4-9a60-6257a1b169ab-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.682922 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.682880 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2860a4ed-3407-43b4-9a60-6257a1b169ab-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.683118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.682947 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhdxs\" (UniqueName: \"kubernetes.io/projected/2860a4ed-3407-43b4-9a60-6257a1b169ab-kube-api-access-nhdxs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.683118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.682971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.683118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.682987 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.683118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.683003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.683118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.683020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.683488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.683464 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.683539 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.683503 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.683574 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.683534 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.685582 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.685557 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2860a4ed-3407-43b4-9a60-6257a1b169ab-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.685643 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.685616 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2860a4ed-3407-43b4-9a60-6257a1b169ab-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.691497 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.691477 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhdxs\" (UniqueName: \"kubernetes.io/projected/2860a4ed-3407-43b4-9a60-6257a1b169ab-kube-api-access-nhdxs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7cbrx\" (UID: \"2860a4ed-3407-43b4-9a60-6257a1b169ab\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.850402 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.850285 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:44:52.992079 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.992054 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx"] Jul 29 17:44:52.994221 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:44:52.994190 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2860a4ed_3407_43b4_9a60_6257a1b169ab.slice/crio-4f6fce941918ade387b63b5b84b41180f9bbbc558aa3c6516793e3d980485cdd WatchSource:0}: Error finding container 4f6fce941918ade387b63b5b84b41180f9bbbc558aa3c6516793e3d980485cdd: Status 404 returned error can't find the container with id 4f6fce941918ade387b63b5b84b41180f9bbbc558aa3c6516793e3d980485cdd Jul 29 17:44:52.995455 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:52.995433 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:44:53.604568 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:53.604533 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" event={"ID":"2860a4ed-3407-43b4-9a60-6257a1b169ab","Type":"ContainerStarted","Data":"4f6fce941918ade387b63b5b84b41180f9bbbc558aa3c6516793e3d980485cdd"} Jul 29 17:44:54.611265 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:54.611222 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" event={"ID":"2860a4ed-3407-43b4-9a60-6257a1b169ab","Type":"ContainerStarted","Data":"c14a38978934b753447e64cc3cf27eaf64ce2990ed180bb7d2306e56b76031c8"} Jul 29 17:44:54.632346 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:44:54.632278 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" podStartSLOduration=1.628311394 podStartE2EDuration="2.63226292s" totalImagesPullingTime="1.003951526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:44:54.630144884 +0000 UTC m=+622.671030189" watchObservedRunningTime="2026-07-29 17:44:54.63226292 +0000 UTC m=+622.673148272" Jul 29 17:45:02.851014 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:02.850972 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:45:02.851495 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:02.851030 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:45:02.863844 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:02.863820 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:45:03.669554 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:03.669524 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7cbrx" Jul 29 17:45:59.857781 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.857747 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft"] Jul 29 17:45:59.860990 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.860973 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:45:59.863351 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.863328 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 29 17:45:59.874694 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.874652 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft"] Jul 29 17:45:59.957485 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.957453 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg2qs\" (UniqueName: \"kubernetes.io/projected/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-kube-api-access-sg2qs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:45:59.957485 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.957488 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:45:59.957732 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.957522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:45:59.957732 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.957582 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:45:59.957732 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.957620 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:45:59.957732 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:45:59.957640 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.059090 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.059055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg2qs\" (UniqueName: \"kubernetes.io/projected/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-kube-api-access-sg2qs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.059090 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.059092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.059360 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.059120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.059360 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.059141 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.059360 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.059179 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.059360 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.059204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.059643 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.059620 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.059701 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.059641 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.059701 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.059675 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.061630 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.061606 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.061900 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.061882 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.067973 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.067931 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg2qs\" (UniqueName: \"kubernetes.io/projected/653bab65-cc9b-4e84-9cb9-1ce88bf233dd-kube-api-access-sg2qs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft\" (UID: \"653bab65-cc9b-4e84-9cb9-1ce88bf233dd\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.170053 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.169954 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:00.312352 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.312322 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft"] Jul 29 17:46:00.314077 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:46:00.314049 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod653bab65_cc9b_4e84_9cb9_1ce88bf233dd.slice/crio-c7f2881f72f84a43c3037664f64e1b23a5c4c6f84e429d6ff29bb2e07d0306d2 WatchSource:0}: Error finding container c7f2881f72f84a43c3037664f64e1b23a5c4c6f84e429d6ff29bb2e07d0306d2: Status 404 returned error can't find the container with id c7f2881f72f84a43c3037664f64e1b23a5c4c6f84e429d6ff29bb2e07d0306d2 Jul 29 17:46:00.950789 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.950693 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" event={"ID":"653bab65-cc9b-4e84-9cb9-1ce88bf233dd","Type":"ContainerStarted","Data":"e8505996a95a4e62a1e59b9466974d9b0088661aaddf6efc8f88e2b020856bb7"} Jul 29 17:46:00.950789 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.950738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" event={"ID":"653bab65-cc9b-4e84-9cb9-1ce88bf233dd","Type":"ContainerStarted","Data":"c7f2881f72f84a43c3037664f64e1b23a5c4c6f84e429d6ff29bb2e07d0306d2"} Jul 29 17:46:00.968931 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:00.968887 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" podStartSLOduration=1.715897017 podStartE2EDuration="1.968870272s" totalImagesPullingTime="252.973255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:46:00.968435646 +0000 UTC m=+689.009320963" watchObservedRunningTime="2026-07-29 17:46:00.968870272 +0000 UTC m=+689.009755561" Jul 29 17:46:10.170392 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:10.170351 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:10.170862 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:10.170413 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:10.183486 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:10.183458 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:11.018359 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:11.018331 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft" Jul 29 17:46:56.008921 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.008839 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cff8bffd8-b5dgt"] Jul 29 17:46:56.012143 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.012123 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" Jul 29 17:46:56.020342 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.020296 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cff8bffd8-b5dgt"] Jul 29 17:46:56.054918 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.054876 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3af302a-0805-493f-ab80-5efbaf1038a0-tls-cert\") pod \"authorino-6cff8bffd8-b5dgt\" (UID: \"d3af302a-0805-493f-ab80-5efbaf1038a0\") " pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" Jul 29 17:46:56.055101 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.054937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh6q2\" (UniqueName: \"kubernetes.io/projected/d3af302a-0805-493f-ab80-5efbaf1038a0-kube-api-access-jh6q2\") pod \"authorino-6cff8bffd8-b5dgt\" (UID: \"d3af302a-0805-493f-ab80-5efbaf1038a0\") " pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" Jul 29 17:46:56.155953 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.155918 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3af302a-0805-493f-ab80-5efbaf1038a0-tls-cert\") pod \"authorino-6cff8bffd8-b5dgt\" (UID: \"d3af302a-0805-493f-ab80-5efbaf1038a0\") " pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" Jul 29 17:46:56.156155 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.155984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh6q2\" (UniqueName: \"kubernetes.io/projected/d3af302a-0805-493f-ab80-5efbaf1038a0-kube-api-access-jh6q2\") pod \"authorino-6cff8bffd8-b5dgt\" (UID: \"d3af302a-0805-493f-ab80-5efbaf1038a0\") " pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" Jul 29 17:46:56.158648 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.158613 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3af302a-0805-493f-ab80-5efbaf1038a0-tls-cert\") pod \"authorino-6cff8bffd8-b5dgt\" (UID: \"d3af302a-0805-493f-ab80-5efbaf1038a0\") " pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" Jul 29 17:46:56.163721 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.163700 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh6q2\" (UniqueName: \"kubernetes.io/projected/d3af302a-0805-493f-ab80-5efbaf1038a0-kube-api-access-jh6q2\") pod \"authorino-6cff8bffd8-b5dgt\" (UID: \"d3af302a-0805-493f-ab80-5efbaf1038a0\") " pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" Jul 29 17:46:56.322782 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.322688 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" Jul 29 17:46:56.481876 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:56.481844 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cff8bffd8-b5dgt"] Jul 29 17:46:56.483133 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:46:56.483103 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3af302a_0805_493f_ab80_5efbaf1038a0.slice/crio-5267d38a8d6e73a80809a586b61804168a254badb77e373f711b8683915ba694 WatchSource:0}: Error finding container 5267d38a8d6e73a80809a586b61804168a254badb77e373f711b8683915ba694: Status 404 returned error can't find the container with id 5267d38a8d6e73a80809a586b61804168a254badb77e373f711b8683915ba694 Jul 29 17:46:57.245964 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.245925 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" event={"ID":"d3af302a-0805-493f-ab80-5efbaf1038a0","Type":"ContainerStarted","Data":"0c723f4537752636031723ced6a054f7818d1efadb7ac709b3e0a8f68affc729"} Jul 29 17:46:57.245964 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.245967 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" event={"ID":"d3af302a-0805-493f-ab80-5efbaf1038a0","Type":"ContainerStarted","Data":"5267d38a8d6e73a80809a586b61804168a254badb77e373f711b8683915ba694"} Jul 29 17:46:57.263149 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.263084 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cff8bffd8-b5dgt" podStartSLOduration=1.636098514 podStartE2EDuration="2.263064907s" totalImagesPullingTime="626.966393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:46:57.260265572 +0000 UTC m=+745.301150863" watchObservedRunningTime="2026-07-29 17:46:57.263064907 +0000 UTC m=+745.303950197" Jul 29 17:46:57.288784 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.288744 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5755596d77-c6t4s"] Jul 29 17:46:57.288978 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.288943 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5755596d77-c6t4s" podUID="87ca7a70-38d2-41fe-bfcd-9b118dd37c3c" containerName="authorino" containerID="cri-o://d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b" gracePeriod=30 Jul 29 17:46:57.551246 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.551213 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:46:57.671155 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.671068 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-tls-cert\") pod \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\" (UID: \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\") " Jul 29 17:46:57.671155 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.671132 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5j5r\" (UniqueName: \"kubernetes.io/projected/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-kube-api-access-l5j5r\") pod \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\" (UID: \"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c\") " Jul 29 17:46:57.673285 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.673258 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-kube-api-access-l5j5r" (OuterVolumeSpecName: "kube-api-access-l5j5r") pod "87ca7a70-38d2-41fe-bfcd-9b118dd37c3c" (UID: "87ca7a70-38d2-41fe-bfcd-9b118dd37c3c"). InnerVolumeSpecName "kube-api-access-l5j5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 17:46:57.684082 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.684057 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "87ca7a70-38d2-41fe-bfcd-9b118dd37c3c" (UID: "87ca7a70-38d2-41fe-bfcd-9b118dd37c3c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 17:46:57.772719 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.772683 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-tls-cert\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:46:57.772719 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:57.772713 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5j5r\" (UniqueName: \"kubernetes.io/projected/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c-kube-api-access-l5j5r\") on node \"ip-10-0-133-94.ec2.internal\" DevicePath \"\"" Jul 29 17:46:58.253201 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.253167 2560 generic.go:356] "Generic (PLEG): container finished" podID="87ca7a70-38d2-41fe-bfcd-9b118dd37c3c" containerID="d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b" exitCode=0 Jul 29 17:46:58.253652 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.253214 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5755596d77-c6t4s" Jul 29 17:46:58.253652 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.253251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5755596d77-c6t4s" event={"ID":"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c","Type":"ContainerDied","Data":"d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b"} Jul 29 17:46:58.253652 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.253290 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5755596d77-c6t4s" event={"ID":"87ca7a70-38d2-41fe-bfcd-9b118dd37c3c","Type":"ContainerDied","Data":"c4c2064dae407482041e48fdfaa9ca898e124387e39e28e4191c12d62a94777a"} Jul 29 17:46:58.253652 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.253327 2560 scope.go:117] "RemoveContainer" containerID="d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b" Jul 29 17:46:58.271597 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.271576 2560 scope.go:117] "RemoveContainer" containerID="d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b" Jul 29 17:46:58.271924 ip-10-0-133-94 kubenswrapper[2560]: E0729 17:46:58.271900 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b\": container with ID starting with d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b not found: ID does not exist" containerID="d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b" Jul 29 17:46:58.272021 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.271930 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b"} err="failed to get container status \"d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b\": rpc error: code = NotFound desc = could not find container \"d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b\": container with ID starting with d8680678a2c7a4a7215625c2a79849dd4fdf0b01c63d265234db0a514c708a3b not found: ID does not exist" Jul 29 17:46:58.280444 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.280410 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5755596d77-c6t4s"] Jul 29 17:46:58.285957 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.285924 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5755596d77-c6t4s"] Jul 29 17:46:58.490694 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:46:58.490668 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ca7a70-38d2-41fe-bfcd-9b118dd37c3c" path="/var/lib/kubelet/pods/87ca7a70-38d2-41fe-bfcd-9b118dd37c3c/volumes" Jul 29 17:47:38.242085 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:38.242049 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cff8bffd8-b5dgt_d3af302a-0805-493f-ab80-5efbaf1038a0/authorino/0.log" Jul 29 17:47:44.001787 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:44.001754 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rkv84_e5c6250e-8df4-4f28-883d-0052f501efc9/server/0.log" Jul 29 17:47:44.123729 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:44.123695 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2vw78_6be5f85a-54d8-43e6-ad0a-8579d2a22c33/manager/0.log" Jul 29 17:47:44.493664 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:44.493639 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-vvfms_621f5e84-3ced-480b-acf2-6d1b53fc6f90/copy-manifests/0.log" Jul 29 17:47:44.499701 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:44.499676 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-vvfms_621f5e84-3ced-480b-acf2-6d1b53fc6f90/manager/0.log" Jul 29 17:47:45.891403 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:45.891369 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8_2e321436-958d-4b91-a458-464252be1279/util/0.log" Jul 29 17:47:45.897410 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:45.897388 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8_2e321436-958d-4b91-a458-464252be1279/pull/0.log" Jul 29 17:47:45.902829 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:45.902801 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8_2e321436-958d-4b91-a458-464252be1279/extract/0.log" Jul 29 17:47:46.016926 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.016897 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn_324d1e40-f9a4-4fe5-be8f-5b1791b16ca7/util/0.log" Jul 29 17:47:46.022985 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.022956 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn_324d1e40-f9a4-4fe5-be8f-5b1791b16ca7/pull/0.log" Jul 29 17:47:46.028963 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.028940 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn_324d1e40-f9a4-4fe5-be8f-5b1791b16ca7/extract/0.log" Jul 29 17:47:46.145270 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.145194 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6_afe6ceed-5181-4f35-b136-fd359cd752a3/util/0.log" Jul 29 17:47:46.150982 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.150961 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6_afe6ceed-5181-4f35-b136-fd359cd752a3/pull/0.log" Jul 29 17:47:46.156665 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.156645 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6_afe6ceed-5181-4f35-b136-fd359cd752a3/extract/0.log" Jul 29 17:47:46.269597 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.269566 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48_e484a71b-c814-4b74-8841-9fedc46addbf/util/0.log" Jul 29 17:47:46.275505 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.275481 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48_e484a71b-c814-4b74-8841-9fedc46addbf/pull/0.log" Jul 29 17:47:46.281413 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.281394 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48_e484a71b-c814-4b74-8841-9fedc46addbf/extract/0.log" Jul 29 17:47:46.399537 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.399446 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cff8bffd8-b5dgt_d3af302a-0805-493f-ab80-5efbaf1038a0/authorino/0.log" Jul 29 17:47:46.749659 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:46.749621 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vwn5x_65afafa4-7e19-42be-876d-baafc290b568/kuadrant-console-plugin/0.log" Jul 29 17:47:47.931760 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:47.931721 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7886b686-rzc26_3fea3ef9-7851-4a34-89be-34341c2a8870/kube-auth-proxy/0.log" Jul 29 17:47:48.390166 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:48.390136 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76556c6d69-rs85g_52abb246-977c-4552-95f8-fe687432925f/router/0.log" Jul 29 17:47:48.855604 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:48.855579 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7cbrx_2860a4ed-3407-43b4-9a60-6257a1b169ab/main/0.log" Jul 29 17:47:49.337932 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:49.337905 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-7n9ft_653bab65-cc9b-4e84-9cb9-1ce88bf233dd/main/0.log" Jul 29 17:47:54.773004 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.772914 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k7j72/must-gather-lm568"] Jul 29 17:47:54.773418 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.773274 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ca7a70-38d2-41fe-bfcd-9b118dd37c3c" containerName="authorino" Jul 29 17:47:54.773418 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.773285 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ca7a70-38d2-41fe-bfcd-9b118dd37c3c" containerName="authorino" Jul 29 17:47:54.773418 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.773354 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ca7a70-38d2-41fe-bfcd-9b118dd37c3c" containerName="authorino" Jul 29 17:47:54.777903 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.777879 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7j72/must-gather-lm568" Jul 29 17:47:54.780510 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.780486 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k7j72\"/\"default-dockercfg-2x995\"" Jul 29 17:47:54.781108 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.781089 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7j72\"/\"openshift-service-ca.crt\"" Jul 29 17:47:54.781176 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.781095 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7j72\"/\"kube-root-ca.crt\"" Jul 29 17:47:54.785711 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.785686 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7j72/must-gather-lm568"] Jul 29 17:47:54.854644 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.854604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6f2c57d-a4e9-4487-8cd4-c089dd2d8067-must-gather-output\") pod \"must-gather-lm568\" (UID: \"b6f2c57d-a4e9-4487-8cd4-c089dd2d8067\") " pod="openshift-must-gather-k7j72/must-gather-lm568" Jul 29 17:47:54.854836 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.854682 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crxp8\" (UniqueName: \"kubernetes.io/projected/b6f2c57d-a4e9-4487-8cd4-c089dd2d8067-kube-api-access-crxp8\") pod \"must-gather-lm568\" (UID: \"b6f2c57d-a4e9-4487-8cd4-c089dd2d8067\") " pod="openshift-must-gather-k7j72/must-gather-lm568" Jul 29 17:47:54.955759 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.955719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crxp8\" (UniqueName: \"kubernetes.io/projected/b6f2c57d-a4e9-4487-8cd4-c089dd2d8067-kube-api-access-crxp8\") pod \"must-gather-lm568\" (UID: \"b6f2c57d-a4e9-4487-8cd4-c089dd2d8067\") " pod="openshift-must-gather-k7j72/must-gather-lm568" Jul 29 17:47:54.955948 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.955789 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6f2c57d-a4e9-4487-8cd4-c089dd2d8067-must-gather-output\") pod \"must-gather-lm568\" (UID: \"b6f2c57d-a4e9-4487-8cd4-c089dd2d8067\") " pod="openshift-must-gather-k7j72/must-gather-lm568" Jul 29 17:47:54.956094 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.956076 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6f2c57d-a4e9-4487-8cd4-c089dd2d8067-must-gather-output\") pod \"must-gather-lm568\" (UID: \"b6f2c57d-a4e9-4487-8cd4-c089dd2d8067\") " pod="openshift-must-gather-k7j72/must-gather-lm568" Jul 29 17:47:54.968955 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:54.968917 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crxp8\" (UniqueName: \"kubernetes.io/projected/b6f2c57d-a4e9-4487-8cd4-c089dd2d8067-kube-api-access-crxp8\") pod \"must-gather-lm568\" (UID: \"b6f2c57d-a4e9-4487-8cd4-c089dd2d8067\") " pod="openshift-must-gather-k7j72/must-gather-lm568" Jul 29 17:47:55.088688 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:55.088585 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7j72/must-gather-lm568" Jul 29 17:47:55.228763 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:55.228738 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7j72/must-gather-lm568"] Jul 29 17:47:55.230408 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:47:55.230377 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6f2c57d_a4e9_4487_8cd4_c089dd2d8067.slice/crio-d7dce3a42fb779c9ad22754b3f9c8b59379ed04600f1123f5f55c933d9965e3a WatchSource:0}: Error finding container d7dce3a42fb779c9ad22754b3f9c8b59379ed04600f1123f5f55c933d9965e3a: Status 404 returned error can't find the container with id d7dce3a42fb779c9ad22754b3f9c8b59379ed04600f1123f5f55c933d9965e3a Jul 29 17:47:55.546167 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:55.546131 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7j72/must-gather-lm568" event={"ID":"b6f2c57d-a4e9-4487-8cd4-c089dd2d8067","Type":"ContainerStarted","Data":"d7dce3a42fb779c9ad22754b3f9c8b59379ed04600f1123f5f55c933d9965e3a"} Jul 29 17:47:56.554921 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:56.554873 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7j72/must-gather-lm568" event={"ID":"b6f2c57d-a4e9-4487-8cd4-c089dd2d8067","Type":"ContainerStarted","Data":"e7e4400bdba8dcdb1c0a027a00261071007b732be6cae9e758432e28879191d5"} Jul 29 17:47:56.554921 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:56.554923 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7j72/must-gather-lm568" event={"ID":"b6f2c57d-a4e9-4487-8cd4-c089dd2d8067","Type":"ContainerStarted","Data":"f9ec04a30c7506e577a3b39337c6cbe52286aab51d8e6c94ca72857651039f52"} Jul 29 17:47:56.573364 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:56.573272 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k7j72/must-gather-lm568" podStartSLOduration=1.6018530960000001 podStartE2EDuration="2.57325524s" totalImagesPullingTime="971.402144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:47:56.570637556 +0000 UTC m=+804.611522844" watchObservedRunningTime="2026-07-29 17:47:56.57325524 +0000 UTC m=+804.614140530" Jul 29 17:47:57.883118 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:57.883078 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nk54l_9a0b10b1-1e60-438e-9ef5-cd3aff57a27b/global-pull-secret-syncer/0.log" Jul 29 17:47:57.995873 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:57.995833 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qcwb6_cdc5063b-6410-4dfe-86c0-a42e4e10b60d/konnectivity-agent/0.log" Jul 29 17:47:58.105099 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:47:58.105070 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-94.ec2.internal_32ce9ec9d7e6ed8fb9a0a2b24a14d2ec/haproxy/0.log" Jul 29 17:48:03.308540 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.308508 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8_2e321436-958d-4b91-a458-464252be1279/extract/0.log" Jul 29 17:48:03.337093 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.337016 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8_2e321436-958d-4b91-a458-464252be1279/util/0.log" Jul 29 17:48:03.362495 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.362463 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596cxx8_2e321436-958d-4b91-a458-464252be1279/pull/0.log" Jul 29 17:48:03.392277 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.392208 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn_324d1e40-f9a4-4fe5-be8f-5b1791b16ca7/extract/0.log" Jul 29 17:48:03.418326 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.418278 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn_324d1e40-f9a4-4fe5-be8f-5b1791b16ca7/util/0.log" Jul 29 17:48:03.445116 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.445084 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0k4bkn_324d1e40-f9a4-4fe5-be8f-5b1791b16ca7/pull/0.log" Jul 29 17:48:03.483882 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.483847 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6_afe6ceed-5181-4f35-b136-fd359cd752a3/extract/0.log" Jul 29 17:48:03.509374 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.509340 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6_afe6ceed-5181-4f35-b136-fd359cd752a3/util/0.log" Jul 29 17:48:03.534100 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.534070 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpmg6_afe6ceed-5181-4f35-b136-fd359cd752a3/pull/0.log" Jul 29 17:48:03.562184 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.562105 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48_e484a71b-c814-4b74-8841-9fedc46addbf/extract/0.log" Jul 29 17:48:03.584392 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.584366 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48_e484a71b-c814-4b74-8841-9fedc46addbf/util/0.log" Jul 29 17:48:03.611099 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.611059 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjh48_e484a71b-c814-4b74-8841-9fedc46addbf/pull/0.log" Jul 29 17:48:03.656625 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.656590 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cff8bffd8-b5dgt_d3af302a-0805-493f-ab80-5efbaf1038a0/authorino/0.log" Jul 29 17:48:03.754949 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:03.754785 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vwn5x_65afafa4-7e19-42be-876d-baafc290b568/kuadrant-console-plugin/0.log" Jul 29 17:48:05.807018 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:05.806966 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-nt2lx_3ba9b7c3-2e7a-4bbd-ac1d-a1e490212f12/cluster-monitoring-operator/0.log" Jul 29 17:48:06.129771 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:06.129664 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpk27_3d6a947a-a0a3-4595-b3aa-d62b62485872/node-exporter/0.log" Jul 29 17:48:06.152370 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:06.152339 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpk27_3d6a947a-a0a3-4595-b3aa-d62b62485872/kube-rbac-proxy/0.log" Jul 29 17:48:06.174296 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:06.174266 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpk27_3d6a947a-a0a3-4595-b3aa-d62b62485872/init-textfile/0.log" Jul 29 17:48:07.959459 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:07.959429 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-5x4vr_fc9af1a1-8db1-4cbe-bb56-5ad5a814882b/networking-console-plugin/0.log" Jul 29 17:48:08.288785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.288745 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8"] Jul 29 17:48:08.296995 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.296962 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.299889 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.299851 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8"] Jul 29 17:48:08.391077 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.391030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-sys\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.391077 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.391082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-podres\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.391386 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.391178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-lib-modules\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.391386 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.391219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-proc\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.391386 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.391264 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6l9s\" (UniqueName: \"kubernetes.io/projected/5a09c061-4771-48aa-89fc-0b00247c683a-kube-api-access-v6l9s\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.491785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.491682 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-lib-modules\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.491785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.491731 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-proc\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.491785 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.491778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6l9s\" (UniqueName: \"kubernetes.io/projected/5a09c061-4771-48aa-89fc-0b00247c683a-kube-api-access-v6l9s\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.492110 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.491838 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-sys\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.492110 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.491858 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-podres\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.492110 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.491883 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-lib-modules\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.492110 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.491898 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-proc\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.492110 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.491982 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-sys\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.492110 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.492088 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a09c061-4771-48aa-89fc-0b00247c683a-podres\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.500357 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.500322 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6l9s\" (UniqueName: \"kubernetes.io/projected/5a09c061-4771-48aa-89fc-0b00247c683a-kube-api-access-v6l9s\") pod \"perf-node-gather-daemonset-mmqm8\" (UID: \"5a09c061-4771-48aa-89fc-0b00247c683a\") " pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.610723 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.610620 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:08.637576 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.637538 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/1.log" Jul 29 17:48:08.641325 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.640127 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-nzz85_9c1e1a5b-4263-4e71-9691-6148749e0e67/console-operator/2.log" Jul 29 17:48:08.815040 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:08.814622 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8"] Jul 29 17:48:08.819891 ip-10-0-133-94 kubenswrapper[2560]: W0729 17:48:08.819589 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5a09c061_4771_48aa_89fc_0b00247c683a.slice/crio-ad90448f12f3f62beb7679a61e6d22f186d87f30a860542b5ff34edb7b47a086 WatchSource:0}: Error finding container ad90448f12f3f62beb7679a61e6d22f186d87f30a860542b5ff34edb7b47a086: Status 404 returned error can't find the container with id ad90448f12f3f62beb7679a61e6d22f186d87f30a860542b5ff34edb7b47a086 Jul 29 17:48:09.660872 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:09.660831 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" event={"ID":"5a09c061-4771-48aa-89fc-0b00247c683a","Type":"ContainerStarted","Data":"c91b745bcc2b846d17084de84ea5b5d02d9736119f3e024fc6e276266cb96899"} Jul 29 17:48:09.661334 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:09.660901 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" event={"ID":"5a09c061-4771-48aa-89fc-0b00247c683a","Type":"ContainerStarted","Data":"ad90448f12f3f62beb7679a61e6d22f186d87f30a860542b5ff34edb7b47a086"} Jul 29 17:48:09.661334 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:09.660933 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:09.679048 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:09.678979 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" podStartSLOduration=1.678955548 podStartE2EDuration="1.678955548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:48:09.677339874 +0000 UTC m=+817.718225166" watchObservedRunningTime="2026-07-29 17:48:09.678955548 +0000 UTC m=+817.719840839" Jul 29 17:48:09.820088 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:09.820052 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-n7dtc_8b772a7a-804d-4cab-a654-9d8dbc5419c3/volume-data-source-validator/0.log" Jul 29 17:48:10.926898 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:10.926872 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lsh69_e5ac0fe1-acb0-4d20-947f-628ee312524b/dns/0.log" Jul 29 17:48:10.946773 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:10.946740 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lsh69_e5ac0fe1-acb0-4d20-947f-628ee312524b/kube-rbac-proxy/0.log" Jul 29 17:48:11.040856 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:11.040829 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s66k8_1d3beb8a-488b-441f-b7d4-01ce783ad5d5/dns-node-resolver/0.log" Jul 29 17:48:11.609675 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:11.609651 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j9sg2_23725b74-f8de-4145-85bc-574758306a84/node-ca/0.log" Jul 29 17:48:12.737063 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:12.737030 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7886b686-rzc26_3fea3ef9-7851-4a34-89be-34341c2a8870/kube-auth-proxy/0.log" Jul 29 17:48:12.842040 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:12.842006 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76556c6d69-rs85g_52abb246-977c-4552-95f8-fe687432925f/router/0.log" Jul 29 17:48:13.486502 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:13.486477 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27m9c_bd5a5082-53b9-47b6-b6d8-159ed283a295/serve-healthcheck-canary/0.log" Jul 29 17:48:14.014153 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:14.014125 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-j7295_2ee85931-a2e7-4ad3-ad32-b5b22184af25/insights-operator/1.log" Jul 29 17:48:14.014153 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:14.014144 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-j7295_2ee85931-a2e7-4ad3-ad32-b5b22184af25/insights-operator/0.log" Jul 29 17:48:14.180764 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:14.180731 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tc7tr_f43b1001-8435-4d80-b26e-40a485fc9aba/kube-rbac-proxy/0.log" Jul 29 17:48:14.201923 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:14.201890 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tc7tr_f43b1001-8435-4d80-b26e-40a485fc9aba/exporter/0.log" Jul 29 17:48:14.225922 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:14.225890 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tc7tr_f43b1001-8435-4d80-b26e-40a485fc9aba/extractor/0.log" Jul 29 17:48:15.680847 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:15.680816 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k7j72/perf-node-gather-daemonset-mmqm8" Jul 29 17:48:16.483026 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:16.482996 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rkv84_e5c6250e-8df4-4f28-883d-0052f501efc9/server/0.log" Jul 29 17:48:16.541770 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:16.541734 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2vw78_6be5f85a-54d8-43e6-ad0a-8579d2a22c33/manager/0.log" Jul 29 17:48:16.702037 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:16.702008 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-vvfms_621f5e84-3ced-480b-acf2-6d1b53fc6f90/manager/0.log" Jul 29 17:48:16.723333 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:16.723284 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78ccbc8659-vvfms_621f5e84-3ced-480b-acf2-6d1b53fc6f90/copy-manifests/0.log" Jul 29 17:48:18.188541 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:18.188514 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-657444d86f-5fp9n_eeca2efd-6a3c-4185-b974-59892733182b/manager/0.log" Jul 29 17:48:19.180992 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:19.180962 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7886b686-rzc26_3fea3ef9-7851-4a34-89be-34341c2a8870/kube-auth-proxy/0.log" Jul 29 17:48:19.245367 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:19.245335 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76556c6d69-rs85g_52abb246-977c-4552-95f8-fe687432925f/router/0.log" Jul 29 17:48:20.470164 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:20.470128 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c7886b686-rzc26_3fea3ef9-7851-4a34-89be-34341c2a8870/kube-auth-proxy/0.log" Jul 29 17:48:20.544488 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:20.544449 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76556c6d69-rs85g_52abb246-977c-4552-95f8-fe687432925f/router/0.log" Jul 29 17:48:23.392141 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:23.392096 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-5sqjf_4e98989f-b739-49c8-a63b-64a7492e4e7d/migrator/0.log" Jul 29 17:48:23.415017 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:23.414989 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-5sqjf_4e98989f-b739-49c8-a63b-64a7492e4e7d/graceful-termination/0.log" Jul 29 17:48:23.801563 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:23.801533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9_9e12b11b-e9f5-4b73-91e7-2f8f1b581579/kube-storage-version-migrator-operator/1.log" Jul 29 17:48:23.802425 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:23.802408 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-ssbl9_9e12b11b-e9f5-4b73-91e7-2f8f1b581579/kube-storage-version-migrator-operator/0.log" Jul 29 17:48:24.857377 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:24.857345 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dxl6_d54bc7ed-6203-453b-81e7-8e0170ffa718/kube-multus-additional-cni-plugins/0.log" Jul 29 17:48:24.900053 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:24.900025 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dxl6_d54bc7ed-6203-453b-81e7-8e0170ffa718/egress-router-binary-copy/0.log" Jul 29 17:48:24.923492 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:24.923469 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dxl6_d54bc7ed-6203-453b-81e7-8e0170ffa718/cni-plugins/0.log" Jul 29 17:48:24.948064 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:24.948041 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dxl6_d54bc7ed-6203-453b-81e7-8e0170ffa718/bond-cni-plugin/0.log" Jul 29 17:48:24.970508 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:24.970480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dxl6_d54bc7ed-6203-453b-81e7-8e0170ffa718/routeoverride-cni/0.log" Jul 29 17:48:24.993209 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:24.993181 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dxl6_d54bc7ed-6203-453b-81e7-8e0170ffa718/whereabouts-cni-bincopy/0.log" Jul 29 17:48:25.015837 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:25.015811 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8dxl6_d54bc7ed-6203-453b-81e7-8e0170ffa718/whereabouts-cni/0.log" Jul 29 17:48:25.367557 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:25.367522 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bstl2_2edba168-5b26-42e4-a3c3-db9d380468c0/kube-multus/0.log" Jul 29 17:48:25.421874 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:25.421845 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2rvxq_638db2e6-2136-4236-b37b-49b391776c7f/network-metrics-daemon/0.log" Jul 29 17:48:25.443980 ip-10-0-133-94 kubenswrapper[2560]: I0729 17:48:25.443915 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2rvxq_638db2e6-2136-4236-b37b-49b391776c7f/kube-rbac-proxy/0.log"